-- Logs begin at Fri 2022-04-29 17:51:13 UTC, end at Fri 2022-04-29 19:02:33 UTC. -- Apr 29 18:27:48.991751 dv-cinder-839987-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Apr 29 18:27:49.001975 dv-cinder-839987-1-smb devstack@keystone.service[80115]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 29 18:27:49.004676 dv-cinder-839987-1-smb devstack@keystone.service[80115]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 29 18:27:49 2022] *** Apr 29 18:27:49.004812 dv-cinder-839987-1-smb devstack@keystone.service[80115]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 29 18:27:49.004927 dv-cinder-839987-1-smb devstack@keystone.service[80115]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 29 18:27:49.005028 dv-cinder-839987-1-smb devstack@keystone.service[80115]: nodename: dv-cinder-839987-1-smb Apr 29 18:27:49.005118 dv-cinder-839987-1-smb devstack@keystone.service[80115]: machine: x86_64 Apr 29 18:27:49.005204 dv-cinder-839987-1-smb devstack@keystone.service[80115]: clock source: unix Apr 29 18:27:49.005301 dv-cinder-839987-1-smb devstack@keystone.service[80115]: pcre jit disabled Apr 29 18:27:49.005402 dv-cinder-839987-1-smb devstack@keystone.service[80115]: detected number of CPU cores: 4 Apr 29 18:27:49.005501 dv-cinder-839987-1-smb devstack@keystone.service[80115]: current working directory: / Apr 29 18:27:49.005602 dv-cinder-839987-1-smb devstack@keystone.service[80115]: detected binary path: /usr/bin/uwsgi-core Apr 29 18:27:49.005707 dv-cinder-839987-1-smb devstack@keystone.service[80115]: your processes number limit is 47680 Apr 29 18:27:49.005800 dv-cinder-839987-1-smb devstack@keystone.service[80115]: your memory page size is 4096 bytes Apr 29 18:27:49.005884 dv-cinder-839987-1-smb devstack@keystone.service[80115]: detected max file descriptor number: 2048 Apr 29 18:27:49.005979 dv-cinder-839987-1-smb devstack@keystone.service[80115]: lock engine: pthread robust mutexes Apr 29 18:27:49.006248 dv-cinder-839987-1-smb devstack@keystone.service[80115]: thunder lock: enabled Apr 29 18:27:49.006547 dv-cinder-839987-1-smb devstack@keystone.service[80115]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 29 18:27:49.006653 dv-cinder-839987-1-smb devstack@keystone.service[80115]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 29 18:27:49.051772 dv-cinder-839987-1-smb devstack@keystone.service[80115]: Python main interpreter initialized at 0x55aff15b79c0 Apr 29 18:27:49.051772 dv-cinder-839987-1-smb devstack@keystone.service[80115]: python threads support enabled Apr 29 18:27:49.051772 dv-cinder-839987-1-smb devstack@keystone.service[80115]: your server socket listen backlog is limited to 100 connections Apr 29 18:27:49.051772 dv-cinder-839987-1-smb devstack@keystone.service[80115]: your mercy for graceful operations on workers is 90 seconds Apr 29 18:27:49.052167 dv-cinder-839987-1-smb devstack@keystone.service[80115]: mapped 403077 bytes (393 KB) for 2 cores Apr 29 18:27:49.052167 dv-cinder-839987-1-smb devstack@keystone.service[80115]: *** Operational MODE: preforking *** Apr 29 18:27:49.052457 dv-cinder-839987-1-smb devstack@keystone.service[80115]: *** uWSGI is running in multiple interpreter mode *** Apr 29 18:27:49.052457 dv-cinder-839987-1-smb devstack@keystone.service[80115]: spawned uWSGI master process (pid: 80115) Apr 29 18:27:49.052652 dv-cinder-839987-1-smb systemd[1]: Started Devstack devstack@keystone.service. Apr 29 18:27:49.054659 dv-cinder-839987-1-smb devstack@keystone.service[80115]: spawned uWSGI worker 1 (pid: 80123, cores: 1) Apr 29 18:27:49.054659 dv-cinder-839987-1-smb devstack@keystone.service[80115]: spawned uWSGI worker 2 (pid: 80124, cores: 1) Apr 29 18:27:49.054659 dv-cinder-839987-1-smb devstack@keystone.service[80115]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 29 18:27:54.768265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 18:27:54.768265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: from cryptography.utils import int_from_bytes Apr 29 18:27:54.769032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 18:27:54.769032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: from cryptography.utils import int_from_bytes Apr 29 18:27:54.772285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 18:27:54.772285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: from cryptography.utils import int_from_bytes Apr 29 18:27:54.772746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 18:27:54.772746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: from cryptography.utils import int_from_bytes Apr 29 18:27:54.818597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 18:27:54.818785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 18:27:54.818982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] command line args: [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 18:27:54.819244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 18:27:54.819482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ================================================================================ {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 18:27:54.819695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] admin_token = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.819918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] config_dir = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.820098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.820326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] config_source = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.820460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] debug = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.820669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.820896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 18:27:54.821050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 18:27:54.821193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] command line args: [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 18:27:54.821469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 18:27:54.821719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ================================================================================ {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 18:27:54.822017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] admin_token = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.822721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] config_dir = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.822888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.823128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] config_source = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.823303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] debug = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.823558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.823808 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.823957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.824100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.824294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.824428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.824428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.824699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.826817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.826817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_config_append = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.826817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.827628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.827765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_dir = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.827765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_file = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_config_append = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_dir = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_file = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.828924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.829848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.830914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.831874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] publish_errors = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.832914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] publish_errors = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.833933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] standard_threads = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.834952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] use_journal = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] use_json = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] standard_threads = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] use_stderr = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] use_syslog = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.835899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.836153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.836153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.836398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.836535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] use_journal = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.836663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.836795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] use_json = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.837008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.837145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] use_stderr = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.837145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] use_syslog = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.837396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.837524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 18:27:54.837652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.837785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.838509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.838655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.838796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.838924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.839057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.839415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.839558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.839768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.839901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.840960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.841913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.842980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.843937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.844876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.845914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.846903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.847996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.848914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.849960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.850097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.850237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.850370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.850765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.850904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.851038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.851228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.851386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.851583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.851746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.851877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.852954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.853870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854010 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.854962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.855932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.856989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.857239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.857239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.857508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.857638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.857767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.857895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.858947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.859951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.860844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.861981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.862885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.863938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.external = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.864872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.password = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] auth.token = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.865928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.866845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867742 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.867872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.868937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.external = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.869952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.password = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] auth.token = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.870883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.871881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.872862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.873961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.874937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.875072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.875238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.875371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.875371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.875699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.875829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.876944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.877865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.878919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.879897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.880951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.881887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.882929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.883880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.884009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.884137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.884525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.884656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.885287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.885417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.885545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.885674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.885822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.885953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.886993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.887975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.888903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.889976 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.890901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.891969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.892924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.893888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.894995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.895281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.895452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.895604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.895742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.895878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.896971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.897940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.898914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.899913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.900050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.900185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.900320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.901872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902618 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.902983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.903212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.903357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.903494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.903641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.903778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] role.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.903925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] role.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.904886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.905926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.906743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.907000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.907209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.907386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.907615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.907789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.907789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] role.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.908877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] role.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.909993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.910923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.911794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.912860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.913961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.914932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.915988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.916131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.916269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.916404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.916548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.916757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.916895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.917869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.918978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.connection = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.919145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.919301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.919441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.919576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.919762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.919905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.920872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.921978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.922936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.connection = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.923934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.924486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 18:27:54.925688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 18:27:54.939555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.939781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.940005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.941711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.941944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.942168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.949308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.951360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.977875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.978106 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.979632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:54.979865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.035831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.043578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.087139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.087426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.091767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.092008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.154199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.154547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.154717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.154875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.155792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.156057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.178028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.178328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.178547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.178695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.178836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.178984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.179171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.179321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.179475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.179618 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.179770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.179910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.180049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.180049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.190917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.191375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.205929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.206154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.206316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.206505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.206648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.206802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.206942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.207097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.207273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.207585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.207735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.207874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.208013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.208164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 18:27:55.224557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.224755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 18:27:55.224913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.225054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 18:27:55.225207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.225348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 18:27:55.225485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.225624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.225762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 18:27:55.225901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.226048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.226187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.226326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.226481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.226622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.226622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.236951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.237225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.237382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.237527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.237669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.237824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.237966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.238101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.246421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.246786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.249725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.250000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.250146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.250284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.250419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.250567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.250708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.250843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.250978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.251152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.251296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.251454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.251593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.251728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.251865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.252845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.279391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.281011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.281285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.283399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.285010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.285288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.286584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.286817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.287237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.290556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.290838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.291301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.294616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.294912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.298704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.299005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.299506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.299798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.300076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.300353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.300623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.300893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.301160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.301426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.303616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.303916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.304201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.304481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.304752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.305020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.305285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.305550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.320576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.320862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.325317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.325608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.325962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.329937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.330188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.330337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.333863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.334282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.335493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.339058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.339318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.342900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.343216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.343496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.343970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.344117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.344270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.344504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.347660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.347966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.348251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.348536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.348814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.349102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.365149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.365447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.365727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.365999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.374392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.376129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.376408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.376869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.377162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.377430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.377692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.379601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.379884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.380167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.380448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.380738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.386388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.388166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.388441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.391609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.391889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.392166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.392450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.392734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.394871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.395172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.395459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.395743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.396026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.396395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.396676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.405961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.406241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.406520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.406798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.407078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.407465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.407749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.414572 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.417934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.421283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.423041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.424779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.425059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.425346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.425499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.428757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.432563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.433103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.434297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.434710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.438149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.438149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.438149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.438511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.438674 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.439060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.439362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.443742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.445355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.449124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.449221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.449413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.449499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.449686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.449837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.450077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.459557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.459557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.459557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.459557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.459557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.459867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.459867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.459867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.460346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.460431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.460963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.461065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.461274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.461554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.461823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.462113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.462389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.467532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 18:27:55.467814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.468095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.468373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.468661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.470059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.470360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.470638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.470915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.471212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.471493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.471778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.472067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.472332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 18:27:55.500589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aff15b79c0 pid: 80123 (default app) Apr 29 18:27:55.504049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7a41-db6a-4ebb-91b1-b148c2646cd5 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:27:55.504346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7a41-db6a-4ebb-91b1-b148c2646cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:27:55.504636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7a41-db6a-4ebb-91b1-b148c2646cd5 None None] PATH_INFO: `/v3` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:27:55.512333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Fri Apr 29 18:27:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:27:55.512454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aff15b79c0 pid: 80124 (default app) Apr 29 18:28:03.524530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91b86-d980-4d46-baa9-6ca39530b854 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:03.525030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91b86-d980-4d46-baa9-6ca39530b854 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:03.525132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91b86-d980-4d46-baa9-6ca39530b854 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:03.526446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:03.534048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:03.534489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:03.534694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:03.565290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG oslo_db.sqlalchemy.engines [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 18:28:03.753846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG passlib.handlers.bcrypt [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80124) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 29 18:28:03.754186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG passlib.handlers.bcrypt [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80124) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 29 18:28:03.809513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:03.811144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:03.937686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1/3] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 29 18:28:04.100065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91b86-d980-4d46-baa9-6ca39530b854 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:04.135248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG oslo_db.sqlalchemy.engines [None req-7ca91b86-d980-4d46-baa9-6ca39530b854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 18:28:04.261230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91b86-d980-4d46-baa9-6ca39530b854 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:04.265526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:04.266184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:04.266470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:04.266747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:04.274767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:04.325848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 29 18:28:04.326188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950e8e-6b34-44e6-b2bf-c9ec50e8c43e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:04.335684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Apr 29 18:28:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 29 18:28:04.341810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:04.356532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861197-c838-4e3a-b385-7bd8aa75b95c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:04.360822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:04.361932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:04.362223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:04.362499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] PATH_INFO: `/v3/projects/c2ad2f44cc08416e8164cdae588a4916` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:04.364034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=c2ad2f44cc08416e8164cdae588a4916)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:04.414047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 29 18:28:04.414393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493c72-cf06-4e74-8b59-fcc5386bb7b5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:04.419886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 2/5] 10.222.0.45 () {56 vars in 1207 bytes} [Fri Apr 29 18:28:04 2022] GET /identity/v3/projects/c2ad2f44cc08416e8164cdae588a4916 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:06.633876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8b7b-414a-4a75-9309-045cd1f26ed2 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:06.635274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8b7b-414a-4a75-9309-045cd1f26ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:06.635371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8b7b-414a-4a75-9309-045cd1f26ed2 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:06.639508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 4/6] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:06.644755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:06.645178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:06.645321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:06.664932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:06.666457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:06.674255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 3/7] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 29 18:28:06.697637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8b7b-414a-4a75-9309-045cd1f26ed2 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:06.709258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8b7b-414a-4a75-9309-045cd1f26ed2 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:06.713441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db85968-d203-4311-8318-1595855ca315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:06.714017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db85968-d203-4311-8318-1595855ca315 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:06.714301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db85968-d203-4311-8318-1595855ca315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:06.714578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db85968-d203-4311-8318-1595855ca315 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:06.721975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db85968-d203-4311-8318-1595855ca315 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:06.723782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db85968-d203-4311-8318-1595855ca315 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:06.732222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 5/8] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Apr 29 18:28:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:28:06.737353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:06.746705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfbc0d-9557-4b93-8567-12f40fd30cd2 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:06.751042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b7c11-d826-4739-96a6-6c7aaae4661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:06.751924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b7c11-d826-4739-96a6-6c7aaae4661a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:06.752208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b7c11-d826-4739-96a6-6c7aaae4661a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:06.752484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b7c11-d826-4739-96a6-6c7aaae4661a admin admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:06.753864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b7c11-d826-4739-96a6-6c7aaae4661a admin admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:06.755730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b7c11-d826-4739-96a6-6c7aaae4661a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:06.757288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 4/9] 10.222.0.45 () {56 vars in 1198 bytes} [Fri Apr 29 18:28:06 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:09.037466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82591-7712-453d-ac78-a2dade47f3d7 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.038000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82591-7712-453d-ac78-a2dade47f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.038000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82591-7712-453d-ac78-a2dade47f3d7 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.039417 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:09.045275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.045685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.045835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.088196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3622cc3-a455-41b2-8896-899c5e1a07e3 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.088489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3622cc3-a455-41b2-8896-899c5e1a07e3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.088771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3622cc3-a455-41b2-8896-899c5e1a07e3 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.090144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 7/11] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:09.095926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473790d-4937-4029-99ed-408758c292d8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.096214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473790d-4937-4029-99ed-408758c292d8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.096495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473790d-4937-4029-99ed-408758c292d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.137962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG passlib.handlers.bcrypt [None req-3473790d-4937-4029-99ed-408758c292d8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80123) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 29 18:28:09.138391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG passlib.handlers.bcrypt [None req-3473790d-4937-4029-99ed-408758c292d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80123) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 29 18:28:09.170211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:09.171427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:09.185145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3473790d-4937-4029-99ed-408758c292d8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:09.186750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3473790d-4937-4029-99ed-408758c292d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:09.247139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 5/12] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:09.270186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.285545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 8/13] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:09.307788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473790d-4937-4029-99ed-408758c292d8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.363677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e47f1-479f-4fb5-a39b-a313f78fc91b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.394974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:09.395795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.396078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.396355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.402695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473790d-4937-4029-99ed-408758c292d8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.407440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:09.418422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:09.419438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:09.420269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 6/14] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:09.425264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.435161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:09.436086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.436378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.436662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.501238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:09.502771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:09.518266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86cf2e-e8f5-4f5b-8d7b-c2b907ba53d5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.550823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:09.551609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.551901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.552184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.552943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:09.553256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:09.554659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:09.570433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 7/15] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:09.575624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.602124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 9/16] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 29 18:28:09.608244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.688105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027a413-a61e-48d0-ab39-380c6d8e1b5b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.725820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:09.726730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.727017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.727330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.729201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:09.730720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:09.732672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 8/17] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:09.738050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.809367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a54824-2e74-433b-85d5-7ba79163e545 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.834717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f1015-3ec1-4d74-a4d4-5b98b50b3761 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.842195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:09.843208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.843495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.843773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.861506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:09.862958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:09.867773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:09.868562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:09.868904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:09.869195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:09.870382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:09.871858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:09.873465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:09.879229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:28:09.882818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:09.883801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:09.885179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:28:09.885179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:28:09.885179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:28:09.885179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:09.885179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:09.890172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:09.977568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb64ae-1c23-4999-a49d-47076ee6f6d7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:09.988966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1f0d5-faed-46bf-b585-890d96a435a4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:10.008820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:10.009971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:10.010255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:10.010536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:10.011402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.domain.id=default, user.id=98401350f90343bfb675fc3a572f111b) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:10.011714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:10.013162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6addd-f5c1-457c-8fdd-d20f235aaeab None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:10.019593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/role_assignments?user.id=98401350f90343bfb675fc3a572f111b&scope.domain.id=default&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:10.020853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:10.021522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:10.021809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:10.022088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:10.022830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:10.023168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:10.024592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844a46-6438-40a7-b563-228a854fe406 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:10.044860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:12.422069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4db84-d5ef-4b9f-8720-54274c51fced None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:12.423080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4db84-d5ef-4b9f-8720-54274c51fced None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:12.423615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4db84-d5ef-4b9f-8720-54274c51fced None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:12.425185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:12.430740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:12.431799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:12.431982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:12.455266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:12.456472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:12.553550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:12.588610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4db84-d5ef-4b9f-8720-54274c51fced None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:12.708846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4db84-d5ef-4b9f-8720-54274c51fced None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:12.756873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:12.758133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:12.758637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:12.759189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:12.776043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:12.784113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:12.784971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:12.785710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:12.788074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 12/24] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:12.796221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:12.924194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe29b-d1c2-4955-a184-0f8f74f407a8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:12.965678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79643863-49e9-4f96-8174-14c269033527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:12.966291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643863-49e9-4f96-8174-14c269033527 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:12.966631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643863-49e9-4f96-8174-14c269033527 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:12.966922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643863-49e9-4f96-8174-14c269033527 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:12.967728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643863-49e9-4f96-8174-14c269033527 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:12.968042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643863-49e9-4f96-8174-14c269033527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:12.969460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643863-49e9-4f96-8174-14c269033527 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:12.987626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 13/25] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:12.993284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:13.040438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d172e-de72-4604-955e-138d5ea151e8 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.041090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d172e-de72-4604-955e-138d5ea151e8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.041589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d172e-de72-4604-955e-138d5ea151e8 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.043191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:13.052272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.052821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.053307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.075088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:13.080721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:13.116288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126fad-56b1-4fe3-9b4b-e9745778c6b9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:13.176795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:13.177977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.178467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.178917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.180332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:13.182604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:13.184588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:12 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:13.190825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:13.205762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 15/28] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:13.274172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:13.331335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab62d2-383f-4c76-8077-6417b7785ae0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:13.376819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:13.377957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.378419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.378874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.380274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:13.381927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:13.383791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:13.391166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:13.401324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71316be8-9056-4296-b4db-b21bfcf6781f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:13.451834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07a78-351a-4eb7-ac8a-861070f0ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:13.453193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07a78-351a-4eb7-ac8a-861070f0ff97 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.453729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07a78-351a-4eb7-ac8a-861070f0ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.454155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07a78-351a-4eb7-ac8a-861070f0ff97 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.455065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a07a78-351a-4eb7-ac8a-861070f0ff97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:13.456628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a07a78-351a-4eb7-ac8a-861070f0ff97 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:13.520151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756421dc-5a7e-4b0e-a796-b5caee5cffe9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:13.566782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94b4e-f451-4670-a1b4-6e4866d92564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:13.567634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94b4e-f451-4670-a1b4-6e4866d92564 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.567920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94b4e-f451-4670-a1b4-6e4866d92564 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.568205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94b4e-f451-4670-a1b4-6e4866d92564 None admin] PATH_INFO: `/v3/domains/default/users/98401350f90343bfb675fc3a572f111b/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.570366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94b4e-f451-4670-a1b4-6e4866d92564 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=98401350f90343bfb675fc3a572f111b, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:13.572484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94b4e-f451-4670-a1b4-6e4866d92564 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:13.669809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 16/30] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Apr 29 18:28:13 2022] POST /identity/v3/roles => generated 219 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:28:13.675131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca6536-d194-4cac-8540-0f377ade3bb6 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.675730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca6536-d194-4cac-8540-0f377ade3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.676239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca6536-d194-4cac-8540-0f377ade3bb6 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.678088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 17/31] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:13.692620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.693227 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.693705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.732659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:13.734570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:13.793010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 15/32] 10.222.0.45 () {58 vars in 1361 bytes} [Fri Apr 29 18:28:13 2022] PUT /identity/v3/domains/default/users/98401350f90343bfb675fc3a572f111b/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:28:13.817599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160992-ee3f-4471-9b67-8c37f9aa720e None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.818229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160992-ee3f-4471-9b67-8c37f9aa720e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.818726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160992-ee3f-4471-9b67-8c37f9aa720e None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.823897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:13.830176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421213-d369-405b-8eef-37e1b98a311a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:13.830805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421213-d369-405b-8eef-37e1b98a311a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:13.831351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421213-d369-405b-8eef-37e1b98a311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:13.852293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 18/34] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:13.860195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-24421213-d369-405b-8eef-37e1b98a311a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:13.862080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-24421213-d369-405b-8eef-37e1b98a311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:13.892596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:13.990052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 17/35] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:14.063831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389775fe-f59a-4f3b-b426-414a1cdcaa5a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:14.070587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24421213-d369-405b-8eef-37e1b98a311a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:14.151152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:14.156164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.156773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.157273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.182676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:14.184676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:28:14.216043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:14.216921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:14.217713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:28:14.217713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:28:14.217713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:28:14.217713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:14.219561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 19/36] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:14.225330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:14.229078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24421213-d369-405b-8eef-37e1b98a311a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:14.268952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143de0c-283c-4224-bad4-8710966454ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:14.269636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143de0c-283c-4224-bad4-8710966454ca None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.269931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143de0c-283c-4224-bad4-8710966454ca None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.270215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143de0c-283c-4224-bad4-8710966454ca None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.270985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143de0c-283c-4224-bad4-8710966454ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:14.272542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143de0c-283c-4224-bad4-8710966454ca None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:14.292600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Apr 29 18:28:14 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:28:14.294324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99d0b2-07f2-45ca-bdb7-1498b9446155 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.294827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99d0b2-07f2-45ca-bdb7-1498b9446155 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.295376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99d0b2-07f2-45ca-bdb7-1498b9446155 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.296917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 19/38] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:14.308337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.309017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.309500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.328415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:14.330068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:14.398215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5984-f9a5-4f38-90bd-91fa7f9740ef None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:14.404531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:14.432219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:14.453987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:14.454692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.454983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.455296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.456427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:14.456746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:14.458305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94187da3-23e0-4c33-a47d-18ddfe125dbf None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:14.473226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 20/40] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:14.474732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdc2d2-3306-4b6f-88bc-0ecb56fbe712 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.475207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdc2d2-3306-4b6f-88bc-0ecb56fbe712 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.475642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdc2d2-3306-4b6f-88bc-0ecb56fbe712 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.477173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 21/41] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:14.482160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdc2d2-3306-4b6f-88bc-0ecb56fbe712 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:14.557625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d108f5-2b9f-49e8-9658-dbeb12587440 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:14.596989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22854d37-8e9f-4ee6-ab7d-111429a19856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:14.597983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22854d37-8e9f-4ee6-ab7d-111429a19856 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.598489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22854d37-8e9f-4ee6-ab7d-111429a19856 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.598987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22854d37-8e9f-4ee6-ab7d-111429a19856 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.599669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdc2d2-3306-4b6f-88bc-0ecb56fbe712 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:14.600062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22854d37-8e9f-4ee6-ab7d-111429a19856 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:14.601477 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22854d37-8e9f-4ee6-ab7d-111429a19856 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:14.614211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Apr 29 18:28:14 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:28:14.623029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.623029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.623029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.636111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:14.637120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.637562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.637985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.639181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:14.640847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:14.641413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:14.642739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:14.676298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 22/43] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:28:14 2022] POST /identity/v3/projects => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:14.737448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 22/44] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:14.762279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:14.877829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204a7fc-7b1a-4319-80ba-1494ad1aff1f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:14.915788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b9524-0050-4a7b-8f25-1d398caa8c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:14.916650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b9524-0050-4a7b-8f25-1d398caa8c8e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:14.916945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b9524-0050-4a7b-8f25-1d398caa8c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:14.917303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b9524-0050-4a7b-8f25-1d398caa8c8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:14.918556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b9524-0050-4a7b-8f25-1d398caa8c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:14.920064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b9524-0050-4a7b-8f25-1d398caa8c8e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:14.921908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 23/45] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:14.927475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:15.022581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db1cb2-e830-41fa-850f-fe90edd85407 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:15.053932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d07e7-7441-427d-970b-916b6a45c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:15.054595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d07e7-7441-427d-970b-916b6a45c363 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:15.054886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d07e7-7441-427d-970b-916b6a45c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:15.055208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d07e7-7441-427d-970b-916b6a45c363 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:15.055923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d07e7-7441-427d-970b-916b6a45c363 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:15.057925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d07e7-7441-427d-970b-916b6a45c363 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:15.083588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:28:14 2022] POST /identity/v3/projects => generated 312 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:16.269527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b251ae-d754-4f68-bb41-5725fc472a1b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:16.270043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b251ae-d754-4f68-bb41-5725fc472a1b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:16.270160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b251ae-d754-4f68-bb41-5725fc472a1b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:16.271497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 24/47] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:16.276537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:16.276948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:16.277099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:16.293290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:16.294466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:16.355385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:16.378603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b251ae-d754-4f68-bb41-5725fc472a1b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:16.480369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b251ae-d754-4f68-bb41-5725fc472a1b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:16.513008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:16.513809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:16.514099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:16.514384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:16.525097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:16.533890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:16.534778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:16.535575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 25/49] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:16.540885 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:16.634090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3a82-8279-4bc6-a153-17e760a61a8d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:16.665890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:16.666549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:16.666835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:16.667127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:16.667887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:16.668197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:16.669583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:16.677336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 25/50] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:16.683867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:16.779443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c3a9a-b9b2-4247-bf3b-064dd1769bfc None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:16.811331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:16.812212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:16.812497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:16.812770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:16.814181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:16.815678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:16.817295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 26/51] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:16 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:16.822790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:16.917832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901abf-b13e-4e87-aae7-d334a80b8c5c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:16.949839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecea6b-1fbd-4f65-8427-3537832c035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:16.950634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecea6b-1fbd-4f65-8427-3537832c035c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:16.950924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecea6b-1fbd-4f65-8427-3537832c035c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:16.951251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecea6b-1fbd-4f65-8427-3537832c035c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:16.952427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecea6b-1fbd-4f65-8427-3537832c035c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:16.953884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecea6b-1fbd-4f65-8427-3537832c035c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:16.955750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 26/52] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:16.961440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:17.056778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6199bf0-5738-45da-bd39-388634569294 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:17.088465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:17.089128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:17.089421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:17.089707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:17.090552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.domain.id=default, user.id=98401350f90343bfb675fc3a572f111b) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:17.090878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:17.092366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e2fbc-2452-4a90-a9f2-a56883d2fa12 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:17.100840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Apr 29 18:28:16 2022] GET /identity/v3/role_assignments?user.id=98401350f90343bfb675fc3a572f111b&scope.domain.id=default&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:17.386374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a62d-a1ab-4fef-9278-66a58dbac942 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:17.386870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a62d-a1ab-4fef-9278-66a58dbac942 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:17.386971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a62d-a1ab-4fef-9278-66a58dbac942 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:17.388346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 27/54] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:17.393460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:17.393819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:17.394034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:17.411047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:17.412258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:17.474076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 28/55] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:17.496679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a62d-a1ab-4fef-9278-66a58dbac942 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:17.592812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a62d-a1ab-4fef-9278-66a58dbac942 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:17.622708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af40680-5c1e-4969-b285-5a103b1f60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:17.623588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40680-5c1e-4969-b285-5a103b1f60d8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:17.623872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40680-5c1e-4969-b285-5a103b1f60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:17.624145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40680-5c1e-4969-b285-5a103b1f60d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:17.625296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af40680-5c1e-4969-b285-5a103b1f60d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:17.626731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af40680-5c1e-4969-b285-5a103b1f60d8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:17.628352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 28/56] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:17.634752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:17.726884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e66c-35c5-4ba7-bdad-52c58a373e82 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:17.758878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c549d-e757-4a3a-b88f-45a3a2b61e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:17.760119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c549d-e757-4a3a-b88f-45a3a2b61e96 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:17.760404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c549d-e757-4a3a-b88f-45a3a2b61e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:17.760683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c549d-e757-4a3a-b88f-45a3a2b61e96 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:17.761394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c549d-e757-4a3a-b88f-45a3a2b61e96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:17.762854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c549d-e757-4a3a-b88f-45a3a2b61e96 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:17.785548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 29/57] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Apr 29 18:28:17 2022] POST /identity/v3/projects => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:28:20.013001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891033-1dce-4656-ace4-2a29bbd2701b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:20.013513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891033-1dce-4656-ace4-2a29bbd2701b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:20.013616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891033-1dce-4656-ace4-2a29bbd2701b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:20.014921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 29/58] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:20.020135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:20.020530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:20.020699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:20.037375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:20.038558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:20.105580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 30/59] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:20.129164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99891033-1dce-4656-ace4-2a29bbd2701b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:20.225497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99891033-1dce-4656-ace4-2a29bbd2701b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:20.256100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc4fc-6c63-4625-a852-466fc18946d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:20.256873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc4fc-6c63-4625-a852-466fc18946d7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:20.257157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc4fc-6c63-4625-a852-466fc18946d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:20.257432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc4fc-6c63-4625-a852-466fc18946d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:20.258585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc4fc-6c63-4625-a852-466fc18946d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:20.260298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc4fc-6c63-4625-a852-466fc18946d7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:20.261870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 30/60] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:20.267393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:20.359626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07cbe3-1ca9-42af-8ee1-c55c5ce472c8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:20.390995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec4e1-c75f-4580-b1e0-0e496167807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:20.391679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec4e1-c75f-4580-b1e0-0e496167807e None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:20.391968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec4e1-c75f-4580-b1e0-0e496167807e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:20.392247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec4e1-c75f-4580-b1e0-0e496167807e None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:20.392956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec4e1-c75f-4580-b1e0-0e496167807e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:20.394391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec4e1-c75f-4580-b1e0-0e496167807e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:20.422067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 31/61] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:20 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:23.820098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff40839-a2cf-4163-b90f-67b5429519d3 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:23.820098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff40839-a2cf-4163-b90f-67b5429519d3 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:23.820098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff40839-a2cf-4163-b90f-67b5429519d3 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:23.820098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 31/62] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:23.825882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:23.826678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:23.827179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:23.850095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:23.851641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:23.920383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628244a4-8019-48d7-af20-81c68bca4959 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:23.920988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628244a4-8019-48d7-af20-81c68bca4959 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:23.921558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628244a4-8019-48d7-af20-81c68bca4959 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:23.923159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:23.928084 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:23.928376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:23.928652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:23.951312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:23.952481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:23.954932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 32/64] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:24.004263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.052648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 33/65] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:24.092207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.123180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6a62-0428-4763-b369-1d9e480ba519 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.157377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.158414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.158838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.159316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.170958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:24.179577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:24.180588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:24.181546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:24.184847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 33/66] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:24.190889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.294555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a6ec5-f1a7-46ac-94a2-4dbd5d1916f6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.309170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab00d-1787-438b-bbb4-2fc9d029c090 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.339419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd126ad-13dd-4acd-9af1-2a46c1e0169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.340598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd126ad-13dd-4acd-9af1-2a46c1e0169f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.341179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd126ad-13dd-4acd-9af1-2a46c1e0169f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.341671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd126ad-13dd-4acd-9af1-2a46c1e0169f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.342643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.343603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.344082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.344550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.345492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:24.345989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:24.347632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbec858-c75e-43d0-b8ce-6619699f4352 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:24.352740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd126ad-13dd-4acd-9af1-2a46c1e0169f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:24.357134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 34/67] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:24.358731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265932c-a0e1-438f-a5d9-4e514a2fca85 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.359287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265932c-a0e1-438f-a5d9-4e514a2fca85 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.359796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265932c-a0e1-438f-a5d9-4e514a2fca85 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.361222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 35/68] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-afd126ad-13dd-4acd-9af1-2a46c1e0169f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:24.363405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:24.364216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:24.364969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:24.367520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:24.368254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265932c-a0e1-438f-a5d9-4e514a2fca85 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.369250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.370299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.370768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.395026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:24.396689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:24.481328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265932c-a0e1-438f-a5d9-4e514a2fca85 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.481805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 35/70] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:24.482559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.515083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327edfee-d265-4331-99ae-be94a7821071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.515996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327edfee-d265-4331-99ae-be94a7821071 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.516287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327edfee-d265-4331-99ae-be94a7821071 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.516571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327edfee-d265-4331-99ae-be94a7821071 None admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.517790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327edfee-d265-4331-99ae-be94a7821071 None admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:24.519296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327edfee-d265-4331-99ae-be94a7821071 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:24.520937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:24.522111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb27ef5-3211-49f3-950a-95f8ae91d780 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.522401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb27ef5-3211-49f3-950a-95f8ae91d780 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.522681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb27ef5-3211-49f3-950a-95f8ae91d780 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.523952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 37/72] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:24.525026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90106f9-98c4-43fd-a12d-d71838f77797 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.525318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90106f9-98c4-43fd-a12d-d71838f77797 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.525601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90106f9-98c4-43fd-a12d-d71838f77797 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.527366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 38/73] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:24.531890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90106f9-98c4-43fd-a12d-d71838f77797 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.580201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b807d2-3f4c-4bee-b3b3-2004d9188f3b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.613063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.613719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.614012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.614294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.615050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:24.615393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:24.616807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:24.624336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 36/74] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:24.625130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.626456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90106f9-98c4-43fd-a12d-d71838f77797 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.658591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cb867-d651-492d-ac26-575ce440ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.659438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cb867-d651-492d-ac26-575ce440ba4c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.659718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cb867-d651-492d-ac26-575ce440ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.660000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cb867-d651-492d-ac26-575ce440ba4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.670269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cb867-d651-492d-ac26-575ce440ba4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-5d9cb867-d651-492d-ac26-575ce440ba4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:24.677944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:24.678817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 39/75] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:24.684455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd642-30e7-41b4-8f57-233c805f786c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.685138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd642-30e7-41b4-8f57-233c805f786c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.685138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd642-30e7-41b4-8f57-233c805f786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.696527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-607fd642-30e7-41b4-8f57-233c805f786c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:24.697758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-607fd642-30e7-41b4-8f57-233c805f786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:24.718025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795de7-c328-411d-890d-2202f320c7e7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.749391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.750036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.750325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.750605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.760828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 40/76] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:24.762094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.762393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.762677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.786702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:24.787900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:24.814812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:24.816324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:24.849888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 41/77] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:24.850706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.909744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 37/78] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:24.911298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:24.942566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1186d95-17a7-4551-8d42-e7d5aa640d7f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:24.974264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:24.975160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:24.975446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:24.975721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:24.989599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:24.991064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:24.992903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 42/79] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:24.993472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.002085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d55e1-1070-4700-800b-33ce56d46bc8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.034460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.035137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.035427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.035706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.036450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:25.036757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.038129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.045891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 38/80] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.046533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.088941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141acde8-ddba-4206-9923-60716ca29384 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.119929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422c54-882a-4374-b819-461936b35112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.120719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422c54-882a-4374-b819-461936b35112 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.121003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422c54-882a-4374-b819-461936b35112 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.121284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422c54-882a-4374-b819-461936b35112 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.122462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422c54-882a-4374-b819-461936b35112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.123949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422c54-882a-4374-b819-461936b35112 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.125550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 43/81] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.127946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422c54-882a-4374-b819-461936b35112 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.141847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340cf4-98a4-4c65-be4b-bb7f3b73efbc None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.173237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.173965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.174252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.174529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.184685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:25.192299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:25.193121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:25.193882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 39/82] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:25.195137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.220759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422c54-882a-4374-b819-461936b35112 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.252458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.253315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.253604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.253883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.255065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.256543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.258237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 44/83] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.258996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.292271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d414be-5d46-482e-9532-8de7d43b017e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.325066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.325710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.325999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.326283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.352730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cf6d5-1b29-46f6-9e96-fcc8f602c7cf None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.387336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.388211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.388503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.388786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.389991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.391480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.392090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.393121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 45/84] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.397795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.397881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.485235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 40/85] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:25.486082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.489311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be2ed-1435-49cd-96f8-eae40f7886f4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.525371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.526079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.526368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.526651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.527409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.528853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.548322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 46/86] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:25 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:25.549308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.584622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836894-6bb9-4682-b409-a5051c3a99da None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.621449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.622137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.622430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.622715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.623516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:25.623842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.625314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.635051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 41/87] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.636374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.654730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffa94d-5420-4064-9616-cb69b590750c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.690201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.690895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.691220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.691507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.692368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=98401350f90343bfb675fc3a572f111b) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:25.692688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.694169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.700302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 47/88] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/role_assignments?user.id=98401350f90343bfb675fc3a572f111b&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.701183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.742691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8fe4-2a09-48bb-9cd7-f51f55ff9a50 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.789836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.789836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.789836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.790148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.819517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486c64e-f0ba-4a3a-834d-7857d74eaa21 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.857083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:25.857989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:25.858328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:25.858545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:25.859835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.861311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.863509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 48/89] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:25.864343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:25.872341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:25.874200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:25.985660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033559-bf6b-4585-877d-c84e17026c4f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:25.996465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 42/90] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:25.997923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:26.030421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.031654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.031654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.032006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.033237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.034700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.036908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 49/91] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:26.037241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:26.102059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6635f-9fc5-4ace-9885-6f8732a18b5b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:26.137418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.138456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.139034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.140456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.140957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf355-cd24-47e8-b72e-1a780caacec4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:26.142527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] RBAC: Adding query filter params (role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=35318d0a3f124e09a063f09d2f564d7d) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:26.143066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.146386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.152994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 43/92] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:25 2022] GET /identity/v3/role_assignments?user.id=35318d0a3f124e09a063f09d2f564d7d&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:26.154097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:26.177139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.178034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.178370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.178655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.180601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.182219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.184271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 50/93] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:26 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:26.190078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:26.260234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f999a-e049-4e13-a229-e2e54e0eb9bb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:26.294935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.295705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd141a-c898-4455-bb54-cc311f7b6080 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:26.297474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.298004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.298486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.331240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.331867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.332152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.332483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.333382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=35318d0a3f124e09a063f09d2f564d7d) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:26.333697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.335458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.341640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 51/94] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:26 2022] GET /identity/v3/role_assignments?user.id=35318d0a3f124e09a063f09d2f564d7d&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=0770ca7325a8434d91507daed896ceb2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:26.377084 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.378938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.495751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 44/95] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:26.504288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:26.649202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2790a8e-2d21-4404-8711-ed1f5bda2dae None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:26.685338 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7487-ca4d-427d-9e67-4dac2e2ece00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.686229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7487-ca4d-427d-9e67-4dac2e2ece00 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.686512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7487-ca4d-427d-9e67-4dac2e2ece00 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.686788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7487-ca4d-427d-9e67-4dac2e2ece00 None admin] PATH_INFO: `/v3/projects/f66a784b0f2d4c6b9324093919ec5baa` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.689951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d7487-ca4d-427d-9e67-4dac2e2ece00 None admin] RBAC: Authorizing `identity:get_project(project_id=f66a784b0f2d4c6b9324093919ec5baa)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.691453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d7487-ca4d-427d-9e67-4dac2e2ece00 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.693272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 52/96] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:26 2022] GET /identity/v3/projects/f66a784b0f2d4c6b9324093919ec5baa => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:26.699959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:26.810366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13be5-1165-4a87-849b-2c93b5a99db4 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:26.843719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:26.844381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:26.844667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:26.844947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:26.845839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=f66a784b0f2d4c6b9324093919ec5baa, user.id=35318d0a3f124e09a063f09d2f564d7d) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:26.846152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:26.847674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db13c6a-329c-4dd6-93cc-1fdeb5dc3bd0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:26.853364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 45/97] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:26 2022] GET /identity/v3/role_assignments?user.id=35318d0a3f124e09a063f09d2f564d7d&scope.project.id=f66a784b0f2d4c6b9324093919ec5baa&role.id=0770ca7325a8434d91507daed896ceb2 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:28.684936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad05795-e26c-4acc-b514-7e2bd9b54bf2 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:28.685472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad05795-e26c-4acc-b514-7e2bd9b54bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:28.685548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad05795-e26c-4acc-b514-7e2bd9b54bf2 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:28.686884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 53/98] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:28.692295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29121f-7f77-434c-b571-945a998d32e6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:28.692721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29121f-7f77-434c-b571-945a998d32e6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:28.692896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29121f-7f77-434c-b571-945a998d32e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:28.712805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7f29121f-7f77-434c-b571-945a998d32e6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:28.713979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7f29121f-7f77-434c-b571-945a998d32e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:28.797442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 46/99] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:28.840744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad05795-e26c-4acc-b514-7e2bd9b54bf2 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:28.971352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad05795-e26c-4acc-b514-7e2bd9b54bf2 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.014647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.015492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.015784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.016065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.018604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a8c1e-cd3f-4462-948e-123d04933b6f None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.018898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a8c1e-cd3f-4462-948e-123d04933b6f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.019206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a8c1e-cd3f-4462-948e-123d04933b6f None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.020598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 47/100] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:29.026520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.026809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.027092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.051776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:29.053036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:29.056388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:29.064625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:29.066365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:29.067324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 54/101] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:29.071873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.131339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 48/102] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:29.154365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.197991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2e409-6d0c-46e1-85a6-f9f858c1986f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.252395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cd3ef-3d59-41d9-a428-dd6933465c7a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.271914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.272615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.272908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.273191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.273959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:29.274274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:29.276256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:29.287401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.288199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.288483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.288763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.297378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 55/103] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:29.299738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:29.302707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:29.307464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:29.309472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:29.311386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 49/104] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:29.319138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.419593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1a353-181c-4798-b9fa-1577af9a64e1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.459488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.462404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.462404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.462404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.462404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:29.462404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:29.463752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d63702-96fb-418a-8d4d-6fca90e02a66 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:29.472238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 50/105] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:29.473552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1e83-9610-4d73-b10c-343352e1cf20 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.473841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1e83-9610-4d73-b10c-343352e1cf20 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.474124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1e83-9610-4d73-b10c-343352e1cf20 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.475075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec73d36-079e-482c-b7cf-cf27aaad887c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.479932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 51/106] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:29.480742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1e83-9610-4d73-b10c-343352e1cf20 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.543550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15afd9-5449-4fb3-b971-3f4d50589653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.544375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15afd9-5449-4fb3-b971-3f4d50589653 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.544671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15afd9-5449-4fb3-b971-3f4d50589653 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.544955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15afd9-5449-4fb3-b971-3f4d50589653 None admin] PATH_INFO: `/v3/users/7fda95e4e13745d497914c1ad38eebc6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.573243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15afd9-5449-4fb3-b971-3f4d50589653 None admin] RBAC: Authorizing `identity:get_user(user_id=7fda95e4e13745d497914c1ad38eebc6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:29.574732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15afd9-5449-4fb3-b971-3f4d50589653 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:29.576617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 56/107] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/users/7fda95e4e13745d497914c1ad38eebc6 => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:29.577837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.578134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.578480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.584523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b1e83-9610-4d73-b10c-343352e1cf20 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.616831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:29.618089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:29.664859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.665758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.666046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.666382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.668527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:29.670027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:29.671791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 52/108] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:29.672593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.753834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 57/109] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:29.754717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.841275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34118ad-93b3-4ed1-a365-7f87cfb13e31 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.870176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154a536-464a-415b-843b-1ca3fe7dac61 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:29.874076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66fa9-0fac-4d60-9915-baeb99a09794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.874729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66fa9-0fac-4d60-9915-baeb99a09794 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.875014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66fa9-0fac-4d60-9915-baeb99a09794 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.875320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66fa9-0fac-4d60-9915-baeb99a09794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.904604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:29.905476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:29.905764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:29.906047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:29.907311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:29.908973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:29.915502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 58/110] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:29.915502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:29.941922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f66fa9-0fac-4d60-9915-baeb99a09794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:29.943512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f66fa9-0fac-4d60-9915-baeb99a09794 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.012107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2604a9-3aae-4b61-b1b5-11c860bfd26c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.039756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 53/111] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:30.043459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63547bd-be04-4891-9a78-35de620690a3 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.043459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63547bd-be04-4891-9a78-35de620690a3 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.043459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63547bd-be04-4891-9a78-35de620690a3 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.043459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 54/112] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:30.048006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898ceb-abf9-4061-ac8b-d49340635281 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.048006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898ceb-abf9-4061-ac8b-d49340635281 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.048006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898ceb-abf9-4061-ac8b-d49340635281 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.050275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 55/113] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:30.051002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898ceb-abf9-4061-ac8b-d49340635281 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.056180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.057548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.057833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.058106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.059306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:30.060759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.062501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 59/114] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:30.067188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.155835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898ceb-abf9-4061-ac8b-d49340635281 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.160881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dd3af-1952-4154-a3aa-d8ed8970f589 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.190021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30da82-0174-4aa9-b515-81c1b7ea1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.190916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30da82-0174-4aa9-b515-81c1b7ea1fc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.191242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30da82-0174-4aa9-b515-81c1b7ea1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.191520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30da82-0174-4aa9-b515-81c1b7ea1fc4 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/98401350f90343bfb675fc3a572f111b/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.193450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30da82-0174-4aa9-b515-81c1b7ea1fc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4979d58f8832476ba4dc8c7f1d06aba4, user_id=98401350f90343bfb675fc3a572f111b, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:30.194916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30da82-0174-4aa9-b515-81c1b7ea1fc4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.195200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdcd1f-4e86-4c01-9e09-4536c4c485c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.196064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdcd1f-4e86-4c01-9e09-4536c4c485c8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.196347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdcd1f-4e86-4c01-9e09-4536c4c485c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.196649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdcd1f-4e86-4c01-9e09-4536c4c485c8 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.197886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdcd1f-4e86-4c01-9e09-4536c4c485c8 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:30.199448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdcd1f-4e86-4c01-9e09-4536c4c485c8 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.201792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 60/115] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:30.203203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.203479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.203947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.212218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 56/116] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:30 2022] PUT /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/98401350f90343bfb675fc3a572f111b/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:30.213287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.213576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.213859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.232433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:30.234095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:30.240399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:30.242063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:30.324853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 57/117] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:30.330851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 61/118] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:30.332036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.332275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.471134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b314-857c-4e5d-affc-7e414844dc89 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.475464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2c18f-2542-4b51-bc22-f08d7f3b83b7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.506291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.506722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.507013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.507329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.508621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:30.511374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.512727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.513713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.514238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.514722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.515796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] RBAC: Adding query filter params (role.id=b5c8440105d04cddbef10dd1db8181fa, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=7fda95e4e13745d497914c1ad38eebc6) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:30.516314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:30.517975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.524454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 62/119] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/role_assignments?user.id=7fda95e4e13745d497914c1ad38eebc6&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=b5c8440105d04cddbef10dd1db8181fa => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:30.526108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.559139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 58/120] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:28:30 2022] POST /identity/v3/projects => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:30.559139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.660557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603d91-d55d-4147-89a1-f68d8c634b35 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.699335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec57384-1fcc-4719-9045-28c33c51f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.700566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57384-1fcc-4719-9045-28c33c51f936 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.701066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57384-1fcc-4719-9045-28c33c51f936 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.701555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57384-1fcc-4719-9045-28c33c51f936 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.714207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec57384-1fcc-4719-9045-28c33c51f936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-8ec57384-1fcc-4719-9045-28c33c51f936 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:30.722642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:30.723631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:30.724459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:30.726969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 63/121] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:30.728727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8b46-a6a9-4099-9e96-f934a3cecd99 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.729739 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8b46-a6a9-4099-9e96-f934a3cecd99 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.730265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8b46-a6a9-4099-9e96-f934a3cecd99 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.732238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 64/122] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:30.736143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23783b85-5083-40d1-bcc3-4180e204d6c9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.737819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.738329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.738914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.768476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:30.770490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:30.790958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.792426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.792951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.792951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.805860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:30.814437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:30.815425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:30.816176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 59/123] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:30.816833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.850537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 65/124] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:30.851536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.920913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f9d92-689c-4a47-95ba-5ac21282f451 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:30.955760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:30.956809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:30.957306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:30.957782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:30.958741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] RBAC: Adding query filter params (name=member) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:30.959384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:30.961010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:30.970319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 60/125] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:30.971456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:30.978194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21121950-91ce-4a31-8868-5cdb975422c8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.013427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.014111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.014442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.015069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.015501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:31.015810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.017200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.026267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 66/126] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.027049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.076423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cc149-ab10-4aa8-805b-78b321e4b286 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.110516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.111720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.112230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.112727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.123363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:31.126573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29628f-ce8f-4a74-ba5d-e0b200690d43 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:31.131727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:31.132586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:31.133354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:31.136480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 61/127] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:31.137488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.166788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.167572 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.167863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.168140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.169379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.170879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.172583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 67/128] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.178813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.239872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b9755-e902-415a-8193-32763f3786a5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.274617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.275939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.276443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.276950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.278414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.280137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.282025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 62/129] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.282995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.382303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f64f-ccfe-4edc-a349-46eafe80d998 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.394061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc920b0-f1d5-4f06-9386-8ff0a80a2de6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.417233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.418436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.418967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.419378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.420722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.422361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.424240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 63/130] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.425108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.433786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.434687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.435570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.436079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.437053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:31.437574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.439222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.450915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 68/131] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.452236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.613848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72d4b-d3d5-49cc-93b3-b447fcdd8dcc None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.620011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00be6ce-deb8-4f18-9c7e-af0ecd1a52d1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.673485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.674353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.674644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.674931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.677840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.679737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.681448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 64/132] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.682780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.684275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.685172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.685456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.685736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/35318d0a3f124e09a063f09d2f564d7d/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.687779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] RBAC: Authorizing `identity:create_grant(project_id=4979d58f8832476ba4dc8c7f1d06aba4, user_id=35318d0a3f124e09a063f09d2f564d7d, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.689248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.713396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 69/133] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:31 2022] PUT /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/35318d0a3f124e09a063f09d2f564d7d/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:31.714214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.857457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463bc6e-445b-44ef-99f4-5b1a8f0ba58c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.903093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddfdc3-976b-4ac7-a20f-3fdacf06c783 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:31.936816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.937852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.940743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.941054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.942476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.944187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.944598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:31.945726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:31.946244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:31.946728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/35318d0a3f124e09a063f09d2f564d7d/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:31.949395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4979d58f8832476ba4dc8c7f1d06aba4, user_id=35318d0a3f124e09a063f09d2f564d7d, role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:31.950171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 65/134] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:31.951448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:31.951819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:31.981706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 70/135] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:31 2022] PUT /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/35318d0a3f124e09a063f09d2f564d7d/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:32.092672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e176a-a18d-45e6-b9dc-3d5b1c5ab6c0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:32.138399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842b77f-e817-407a-b899-d73b87467c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:32.139323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b77f-e817-407a-b899-d73b87467c39 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:32.139619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b77f-e817-407a-b899-d73b87467c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:32.139903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842b77f-e817-407a-b899-d73b87467c39 None admin] PATH_INFO: `/v3/projects/f66a784b0f2d4c6b9324093919ec5baa` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:32.141182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842b77f-e817-407a-b899-d73b87467c39 None admin] RBAC: Authorizing `identity:get_project(project_id=f66a784b0f2d4c6b9324093919ec5baa)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:32.142684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842b77f-e817-407a-b899-d73b87467c39 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:32.144797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 66/136] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:31 2022] GET /identity/v3/projects/f66a784b0f2d4c6b9324093919ec5baa => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:32.152591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:32.282955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa033d1b-923f-4437-9e1d-05df165876e7 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:32.316975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801bfc-7c68-44d8-9559-b8bdde58aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:32.317874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801bfc-7c68-44d8-9559-b8bdde58aa94 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:32.318156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801bfc-7c68-44d8-9559-b8bdde58aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:32.318431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801bfc-7c68-44d8-9559-b8bdde58aa94 None admin] PATH_INFO: `/v3/projects/f66a784b0f2d4c6b9324093919ec5baa/users/35318d0a3f124e09a063f09d2f564d7d/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:32.320424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09801bfc-7c68-44d8-9559-b8bdde58aa94 None admin] RBAC: Authorizing `identity:create_grant(project_id=f66a784b0f2d4c6b9324093919ec5baa, user_id=35318d0a3f124e09a063f09d2f564d7d, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:32.321875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09801bfc-7c68-44d8-9559-b8bdde58aa94 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:32.337051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 71/137] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:32 2022] PUT /identity/v3/projects/f66a784b0f2d4c6b9324093919ec5baa/users/35318d0a3f124e09a063f09d2f564d7d/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:33.198516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365005-87b5-4cc8-9444-b52f5edc4dbe None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.199027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365005-87b5-4cc8-9444-b52f5edc4dbe None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.199099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365005-87b5-4cc8-9444-b52f5edc4dbe None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.200496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 67/138] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:33.205902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.206344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.206516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.227084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:33.228414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:33.298758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 72/139] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:33.322408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365005-87b5-4cc8-9444-b52f5edc4dbe None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:33.426389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365005-87b5-4cc8-9444-b52f5edc4dbe None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:33.471622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c77ff3-ad99-4212-bab5-ee7f326d1ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:33.472432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c77ff3-ad99-4212-bab5-ee7f326d1ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.472724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c77ff3-ad99-4212-bab5-ee7f326d1ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.473012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c77ff3-ad99-4212-bab5-ee7f326d1ca5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.484345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c77ff3-ad99-4212-bab5-ee7f326d1ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-53c77ff3-ad99-4212-bab5-ee7f326d1ca5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:33.492159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:33.494202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:33.496117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 68/140] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:33.499941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:33.601751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22606-4b6b-4565-b721-faee5bf0ddb0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:33.647834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:33.648546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.648838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.649124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.649902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:33.650214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:33.652213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:33.657789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ca79b-35ae-4956-bc8e-29c1bac5aec4 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.658085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ca79b-35ae-4956-bc8e-29c1bac5aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.658377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ca79b-35ae-4956-bc8e-29c1bac5aec4 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.659992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 69/141] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:33.664601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0551-38f7-40c4-8034-db377e494fca None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.664891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0551-38f7-40c4-8034-db377e494fca None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.665178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da0551-38f7-40c4-8034-db377e494fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.681304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 73/142] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:33.691069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:33.692699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-30da0551-38f7-40c4-8034-db377e494fca None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:33.693900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-30da0551-38f7-40c4-8034-db377e494fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:33.801224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 70/143] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:33.836083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da0551-38f7-40c4-8034-db377e494fca None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:33.898783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4d286-c1e1-4b50-826c-32e804abc75c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:33.946710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da0551-38f7-40c4-8034-db377e494fca None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:33.985395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:33.986372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.986767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.987181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.995889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:33.996802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:33.997092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:33.997373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] PATH_INFO: `/v3/users/7fda95e4e13745d497914c1ad38eebc6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:33.998660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] RBAC: Authorizing `identity:get_user(user_id=7fda95e4e13745d497914c1ad38eebc6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:33.999245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:34.000135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:34.002076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 74/144] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:33 2022] GET /identity/v3/users/7fda95e4e13745d497914c1ad38eebc6 => generated 289 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:34.012184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:34.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:34.014451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:34.015861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 71/145] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:34.021195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:34.114196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e817da-d9b8-4116-bf40-4225e9b298a6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:34.154393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:34.155288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.155574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.155853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.159322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:34.161574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:34.163511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 75/146] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:34 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:34.170630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:34.194165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a85d6-9d37-4d8f-a910-d096c1903157 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:34.262381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:34.263070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.263354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.263633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.264461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:34.264769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:34.267508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:34.283467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 72/147] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:34.289484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:34.357505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6b33-544c-49fb-a5a1-10f692e1b8cf None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:34.426280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092659b-432e-4035-9d58-d1bbf4abbddc None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:34.450513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:34.451454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.451740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.452014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/7fda95e4e13745d497914c1ad38eebc6/roles/b5c8440105d04cddbef10dd1db8181fa` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.455029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] RBAC: Authorizing `identity:create_grant(project_id=4979d58f8832476ba4dc8c7f1d06aba4, user_id=7fda95e4e13745d497914c1ad38eebc6, role_id=b5c8440105d04cddbef10dd1db8181fa)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:34.456515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:34.482526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 76/148] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:34 2022] PUT /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/users/7fda95e4e13745d497914c1ad38eebc6/roles/b5c8440105d04cddbef10dd1db8181fa => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:34.489380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2e68-986e-48df-b3a3-9e9ee5db80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:34.490283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2e68-986e-48df-b3a3-9e9ee5db80ff None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.490567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2e68-986e-48df-b3a3-9e9ee5db80ff None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.490845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2e68-986e-48df-b3a3-9e9ee5db80ff None admin] PATH_INFO: `/v3/users/98401350f90343bfb675fc3a572f111b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.492268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e2e68-986e-48df-b3a3-9e9ee5db80ff None admin] RBAC: Authorizing `identity:get_user(user_id=98401350f90343bfb675fc3a572f111b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:34.493798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e2e68-986e-48df-b3a3-9e9ee5db80ff None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:34.496615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 73/149] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:34 2022] GET /identity/v3/users/98401350f90343bfb675fc3a572f111b => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:34.504399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:34.651684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3bb8-ba2b-4a1b-a8d7-94ef818ea6df None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:34.699938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:34.700537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.700831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.701115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.790875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:34.792459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:34.835160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c291e-fdec-4390-82c9-ffc1baf2d176 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.835476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c291e-fdec-4390-82c9-ffc1baf2d176 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.835743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c291e-fdec-4390-82c9-ffc1baf2d176 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.838964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 74/150] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:34.845090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:34.845090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:34.845090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:34.876649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:34.880577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:34.952430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 77/151] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:34.955534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 75/152] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:34.959130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:34.980697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:35.084161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119e9dc-c499-4ed4-b539-82ec7fb83a89 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:35.121402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:35.122618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.123160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.123657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.125166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:35.126883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:35.128931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 76/153] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:35.135472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:35.153148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4d888-df89-4c21-a02d-79b89f9479b9 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:35.228973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:35.229712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.229999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.230285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.235886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:35.236849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b330c-3171-492f-aed7-43c303c3ff29 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:35.237367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:35.239153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 78/154] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:34 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:35.246218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:35.276654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2380f7-3f45-43b7-ab1f-78e09164f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:35.278024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2380f7-3f45-43b7-ab1f-78e09164f560 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.278537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2380f7-3f45-43b7-ab1f-78e09164f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.279017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2380f7-3f45-43b7-ab1f-78e09164f560 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.279970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2380f7-3f45-43b7-ab1f-78e09164f560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:35.281652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2380f7-3f45-43b7-ab1f-78e09164f560 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:35.334103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 77/155] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:35 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:35.338326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def63ae-e279-4038-8492-c9561134e069 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.338870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def63ae-e279-4038-8492-c9561134e069 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.339378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def63ae-e279-4038-8492-c9561134e069 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.340921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 78/156] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:35.348385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.348990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.349501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.374625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:35.376251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:35.403214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc6f5-b6b9-4bd9-84b0-f928c0b37c00 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:35.443705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:35.444395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.444680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.444954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.445812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=98401350f90343bfb675fc3a572f111b) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:35.446124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:35.447700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61365cac-40a8-45b4-a019-a8531de18025 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:35.454263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 79/157] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:35 2022] GET /identity/v3/role_assignments?user.id=98401350f90343bfb675fc3a572f111b&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:35.455616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005fe86-313c-4dd9-8645-afc9ebbb31b8 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.455900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005fe86-313c-4dd9-8645-afc9ebbb31b8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.456177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005fe86-313c-4dd9-8645-afc9ebbb31b8 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.459746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 80/158] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:35.463039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.463357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.463667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.466018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 79/159] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:35.499484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:35.500622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:35.501879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:35.619019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 81/160] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:35.663693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:35.734873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11a87b-f6f2-4dc2-a075-72c136bc12d7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:35.788234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302a93-9da1-41a9-a215-76c06e0310aa None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:35.825617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:35.826509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.826790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.827068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.833573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:35.834400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:35.834686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:35.835165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:35.839691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:35.849645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:35.850536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:35.851355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 80/161] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:28:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:35.853398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:35.862025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:35.863080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:35.864415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 82/162] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:35.866134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:35.870550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.016545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1367-a371-4754-b7be-623f9b290ec2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.020021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3add-77cf-4e30-9f9c-92dd1d53b5df None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.062798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.063439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.063725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.064010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.064769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:36.065077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.066535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874ab9-ea09-41cc-9fa0-9011e24ce2f9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.069494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.070276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.070636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.070989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.071872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:36.072790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.074258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f83cb-21e3-49d6-ba55-1c8c3bfbdc77 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.075854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 81/163] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:28:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:36.077303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a5a01-c197-41e6-a4de-2595fadeeb68 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.077743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a5a01-c197-41e6-a4de-2595fadeeb68 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.078163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a5a01-c197-41e6-a4de-2595fadeeb68 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.079603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 82/164] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:36.081865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a5a01-c197-41e6-a4de-2595fadeeb68 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.084800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 83/165] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:36.088580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.089831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.090261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.117262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:36.119596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:36.211363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a5a01-c197-41e6-a4de-2595fadeeb68 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.212664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 84/166] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:36.214438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.269775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.270866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.271260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.271640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.273050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.274672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.277257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 83/167] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:36.278216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.329789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b49b8-4c01-401e-a2f3-d0cc7b638f4d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.364769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.365899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.366365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.366853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.368278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.369989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.371927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 85/168] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:36.372876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.382986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab8a3-fc28-4a3a-85f8-35a08c1ad299 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.417751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.418639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.418999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.419378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.429852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:36.438332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:36.439300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:36.440169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 84/169] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:36.440939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.493071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ed19-ce4e-47fc-925d-0b2dd9749c68 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.531924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.532822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.533254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.533758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.551234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3d96-b3c4-4594-910e-36044adf6404 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.585633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.586202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.586529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.586751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.604906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.606658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.655087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.656589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.714629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 86/170] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:36.715795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.757244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 85/171] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:36.758344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.823506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbad7bf-4bfc-4693-9ecb-2a85db39d8da None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.866398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.868339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.868991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.871239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.872198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:36.873354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.874957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.891505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddc232-2734-401f-929c-1b853012f774 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:36.907537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 87/172] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:36.909444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:36.976841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:36.978042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:36.979136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:36.979593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:36.982518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:36.988826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:36.990813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:36.991829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:37.103980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699269c4-911c-4d5a-97a5-d0966723fe56 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:37.172053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:37.173206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.173671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.174263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.176340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:37.177986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:37.180571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 88/174] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:37.181733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:37.189031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95367e6-fb3a-4f9e-a3da-98040d928768 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:37.240876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117edf9-2971-423b-a07a-520273927119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:37.241841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117edf9-2971-423b-a07a-520273927119 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.242030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117edf9-2971-423b-a07a-520273927119 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.242305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117edf9-2971-423b-a07a-520273927119 None admin] PATH_INFO: `/v3/users/35318d0a3f124e09a063f09d2f564d7d` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.243647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117edf9-2971-423b-a07a-520273927119 None admin] RBAC: Authorizing `identity:get_user(user_id=35318d0a3f124e09a063f09d2f564d7d)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:37.245130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117edf9-2971-423b-a07a-520273927119 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:37.246759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 87/175] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:36 2022] GET /identity/v3/users/35318d0a3f124e09a063f09d2f564d7d => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:37.247644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117edf9-2971-423b-a07a-520273927119 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:37.303799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4a23-17ba-4fab-843e-155c54296638 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:37.348497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:37.349878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.350531 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.351220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.352603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] RBAC: Adding query filter params (role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=35318d0a3f124e09a063f09d2f564d7d) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:37.353130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:37.355426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:37.364455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 89/176] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:37 2022] GET /identity/v3/role_assignments?user.id=35318d0a3f124e09a063f09d2f564d7d&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:37.365626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:37.477264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117edf9-2971-423b-a07a-520273927119 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:37.480021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7e24-5543-412c-b1ee-28b7ec9fa2e6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:37.516874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:37.518506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.519014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.519511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.570639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:37.571345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.571627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.572021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.573550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=35318d0a3f124e09a063f09d2f564d7d) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:37.573722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:37.575241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:37.590771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 88/177] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:37 2022] GET /identity/v3/role_assignments?user.id=35318d0a3f124e09a063f09d2f564d7d&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=0770ca7325a8434d91507daed896ceb2 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:37.602938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:37.604902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:37.730688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 90/178] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:37.740299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:37.871288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ba2e1-a492-473c-bb03-f1fb41d184b5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:37.911169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2d42-d9e4-4f72-b462-570dfbe76379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:37.915796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2d42-d9e4-4f72-b462-570dfbe76379 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.916224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2d42-d9e4-4f72-b462-570dfbe76379 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.916650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2d42-d9e4-4f72-b462-570dfbe76379 None admin] PATH_INFO: `/v3/projects/f66a784b0f2d4c6b9324093919ec5baa` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.917987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2d42-d9e4-4f72-b462-570dfbe76379 None admin] RBAC: Authorizing `identity:get_project(project_id=f66a784b0f2d4c6b9324093919ec5baa)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:37.919808 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2d42-d9e4-4f72-b462-570dfbe76379 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:37.922062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 89/179] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:37 2022] GET /identity/v3/projects/f66a784b0f2d4c6b9324093919ec5baa => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:37.929545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:37.932493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb6a1-7e86-4ea9-ac12-664b495749ff None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.932777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb6a1-7e86-4ea9-ac12-664b495749ff None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.933051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb6a1-7e86-4ea9-ac12-664b495749ff None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.934791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 90/180] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:37.943223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:37.943223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:37.943223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:37.972135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:37.973342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:38.054473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaa0d-27ac-444f-b757-6bcffa875a68 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:38.068663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 91/181] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:38.090301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:38.090965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:38.091269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:38.091545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:38.092380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=f66a784b0f2d4c6b9324093919ec5baa, user.id=35318d0a3f124e09a063f09d2f564d7d) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:38.092688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:38.094251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:38.100833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 91/182] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:37 2022] GET /identity/v3/role_assignments?user.id=35318d0a3f124e09a063f09d2f564d7d&scope.project.id=f66a784b0f2d4c6b9324093919ec5baa&role.id=0770ca7325a8434d91507daed896ceb2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:38.103083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:38.238267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0295a6e-9c53-4570-9de6-80d6ea365848 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:38.282387 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:38.283507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:38.284021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:38.284440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:38.297839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:38.306088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:38.307840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:38.308657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:38.311037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 92/183] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:38.317938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:38.436677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b334c-584b-4840-8132-1ed5791ba87a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:38.477209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:38.477906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:38.478189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:38.478998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:38.479796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:38.480103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:38.481483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:38.491265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 92/184] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:38.500199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:38.621271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420408b-6bcb-4fb5-abca-4e97d3e074e1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:38.660253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:38.661481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:38.661968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:38.662444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] PATH_INFO: `/v3/users/7fda95e4e13745d497914c1ad38eebc6` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:38.664464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] RBAC: Authorizing `identity:get_user(user_id=7fda95e4e13745d497914c1ad38eebc6)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:38.666724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:38.668612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 93/185] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:38 2022] GET /identity/v3/users/7fda95e4e13745d497914c1ad38eebc6 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:38.676221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:38.777029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca523bc-b25f-4d58-946f-f9cce77eb60a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:38.810822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480848e-9055-4572-b891-cf6c1b58dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:38.811513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480848e-9055-4572-b891-cf6c1b58dc7b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:38.811802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480848e-9055-4572-b891-cf6c1b58dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:38.812083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480848e-9055-4572-b891-cf6c1b58dc7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:38.885208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480848e-9055-4572-b891-cf6c1b58dc7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:38.886628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480848e-9055-4572-b891-cf6c1b58dc7b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:38.987698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 93/186] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:38.993261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.059192 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eb3f-4115-426c-a16b-6f34387fcfd0 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.059551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eb3f-4115-426c-a16b-6f34387fcfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.059760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eb3f-4115-426c-a16b-6f34387fcfd0 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.061516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 94/187] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:39.068358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.068672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.068913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.087061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:39.088933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:39.102335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947d19e-891e-49f0-a12c-9cca9c2da606 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.143415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.144624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.145176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.145460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.146827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.148893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.152066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 94/188] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:38 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:39.157771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.160977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 95/189] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:39.184100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.255337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e5809-33d8-494d-ac7f-cd2fda2d91ef None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.282581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e05db0-ab1d-4b7e-a6ac-8d92de0bf197 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.289326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.289987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.290271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.290548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.291454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] RBAC: Adding query filter params (role.id=b5c8440105d04cddbef10dd1db8181fa, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4, user.id=7fda95e4e13745d497914c1ad38eebc6) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:39.291769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.293220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af22c3b-c5f9-4ed5-b638-bbdb4310231a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.300120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 95/190] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/role_assignments?user.id=7fda95e4e13745d497914c1ad38eebc6&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=b5c8440105d04cddbef10dd1db8181fa => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:39.301356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40786e-3070-4bbe-86f2-03ccd948f6be None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.301640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40786e-3070-4bbe-86f2-03ccd948f6be None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.301914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40786e-3070-4bbe-86f2-03ccd948f6be None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.303353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 96/191] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:39.308877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.309158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.309442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.327315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:39.328625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:39.334490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.335736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.336220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.336687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.352442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:39.363624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:39.364768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:39.365729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:39.369700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 96/192] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:39.375923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.413136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 97/193] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:39.440544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.511082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d9f8-7290-469e-ba3f-7bea50230060 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.547566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.548312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.548581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.548857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.549643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:39.549952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.551440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.564092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 97/194] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:39.566432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746b4ad-4637-46e4-82fd-b902eea856b0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.569245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.602584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.603476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.603757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.604506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.615892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:39.624547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:39.625434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:39.626228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 98/195] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:39.632400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.678907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fa626-f409-4dbc-be21-9fa4d763f592 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.711684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fb962-3fb6-4620-92fb-71d5c7863efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.712568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fb962-3fb6-4620-92fb-71d5c7863efa None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.712898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fb962-3fb6-4620-92fb-71d5c7863efa None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.713174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fb962-3fb6-4620-92fb-71d5c7863efa None admin] PATH_INFO: `/v3/users/b68994b5ac9541309d530a2943478104` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.726024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fb962-3fb6-4620-92fb-71d5c7863efa None admin] RBAC: Authorizing `identity:get_user(user_id=b68994b5ac9541309d530a2943478104)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.727521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fb962-3fb6-4620-92fb-71d5c7863efa None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.729991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 98/196] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/users/b68994b5ac9541309d530a2943478104 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:39.732039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66a43-0373-4961-876f-a7afaa562270 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.732542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66a43-0373-4961-876f-a7afaa562270 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.733038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66a43-0373-4961-876f-a7afaa562270 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.734717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 99/197] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:39.735672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a66a43-0373-4961-876f-a7afaa562270 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.740949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e89f6-1793-4da6-8dfc-df589639a3ee None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.775088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.775791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.776077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.776353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.777103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:39.777413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.778802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041d4a-e14c-402d-b39a-954d8408020b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.786512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 99/198] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:39.788536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.788830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.789113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.805268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:39.806448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:39.832284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a66a43-0373-4961-876f-a7afaa562270 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.863809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.864455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.864730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.865001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.868462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 100/199] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:39.869138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:39.930098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.931536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.961075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0bdc9-5ceb-493f-bbbf-425e8cf28a20 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:39.992276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:39.993200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:39.993482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:39.993752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] PATH_INFO: `/v3/users/b68994b5ac9541309d530a2943478104` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:39.995593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] RBAC: Authorizing `identity:get_user(user_id=b68994b5ac9541309d530a2943478104)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:39.997026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:39.998640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 101/200] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/users/b68994b5ac9541309d530a2943478104 => generated 283 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:39.999416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.028590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 100/201] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:40.028590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.090691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb12813-ee3b-462d-b160-883d0a2324a8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.118661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99735ffb-6de8-45a9-a112-f11f86ce2f90 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.124780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.125571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.125852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.126125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.127304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.128756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.130364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 102/202] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:40.131971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.152364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.153012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.153290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.153562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.215460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.216942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.223584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fce82e-b414-441c-bc90-90e516508139 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.255171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.256013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.256296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.256574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.257777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.259265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.261248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 103/203] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:40 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:40.266078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.307853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 101/204] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:40.308745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.356700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1505417-96ca-42a6-9577-1a897628891a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.388506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.389162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.389440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.389711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.390416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.391982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.398736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfde7-5065-418f-ab85-e5bb6faad90f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.412068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 104/205] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:40 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:40.423970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.438548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.439617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.439900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.440215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.441096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=b68994b5ac9541309d530a2943478104) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:40.441410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.442918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.449826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 102/206] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:40 2022] GET /identity/v3/role_assignments?user.id=b68994b5ac9541309d530a2943478104&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:40.545824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cce23b-ce2b-47b7-b664-540dee7f2edc None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.582841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434232-5721-4206-a135-946865cdbb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.583793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434232-5721-4206-a135-946865cdbb29 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.584074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434232-5721-4206-a135-946865cdbb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.584352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434232-5721-4206-a135-946865cdbb29 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.585661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99434232-5721-4206-a135-946865cdbb29 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.587226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99434232-5721-4206-a135-946865cdbb29 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.589230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 105/207] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:40 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:40.595417 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:40.701100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243577e8-5fbf-4032-a7f9-3401897f6924 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:40.737200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:40.737935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:40.738344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:40.738716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:40.739715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] RBAC: Adding query filter params (role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=b68994b5ac9541309d530a2943478104) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:40.740075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:40.741481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059e2ce-1863-48d9-a144-2d0a0624a990 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:40.748359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 103/208] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:40 2022] GET /identity/v3/role_assignments?user.id=b68994b5ac9541309d530a2943478104&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:42.748739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7f000-b7ea-4125-9f38-06d46e547d18 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:42.749231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7f000-b7ea-4125-9f38-06d46e547d18 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:42.749231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7f000-b7ea-4125-9f38-06d46e547d18 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:42.750597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 106/209] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:42.756072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76309911-973a-4161-aa5b-41fcffe0425f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:42.756476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76309911-973a-4161-aa5b-41fcffe0425f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:42.756641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76309911-973a-4161-aa5b-41fcffe0425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:42.773826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-76309911-973a-4161-aa5b-41fcffe0425f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:42.775026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-76309911-973a-4161-aa5b-41fcffe0425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:42.846573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cfea9-1d9b-44f0-8964-2d90bc0605fe None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:42.846877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cfea9-1d9b-44f0-8964-2d90bc0605fe None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:42.847141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cfea9-1d9b-44f0-8964-2d90bc0605fe None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:42.847593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 104/210] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:42.850034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 107/211] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:42.854533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc00b9-8383-4551-a625-7cbee7ea986f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:42.854823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc00b9-8383-4551-a625-7cbee7ea986f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:42.855134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc00b9-8383-4551-a625-7cbee7ea986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:42.871684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8acc00b9-8383-4551-a625-7cbee7ea986f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:42.872380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cfea9-1d9b-44f0-8964-2d90bc0605fe None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:42.872857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8acc00b9-8383-4551-a625-7cbee7ea986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:42.942730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 105/212] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:42.952591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1b954-3e06-4e19-b571-7b1199842693 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:42.952879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1b954-3e06-4e19-b571-7b1199842693 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:42.953163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1b954-3e06-4e19-b571-7b1199842693 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:42.954482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 106/213] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:42.959626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca1bf5-0afd-4ac6-b147-4f249ba449db None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:42.959914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca1bf5-0afd-4ac6-b147-4f249ba449db None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:42.960195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca1bf5-0afd-4ac6-b147-4f249ba449db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:42.979762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b4ca1bf5-0afd-4ac6-b147-4f249ba449db None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:42.981751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b4ca1bf5-0afd-4ac6-b147-4f249ba449db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:42.997161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cfea9-1d9b-44f0-8964-2d90bc0605fe None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.033568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.034272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.034551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.034823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.044645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:43.052265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:43.053142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:43.053921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 108/214] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:43.054568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.055352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 107/215] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:43.061529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4933f02-49ff-4add-88dd-09793b735ce2 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.061529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4933f02-49ff-4add-88dd-09793b735ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.061529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4933f02-49ff-4add-88dd-09793b735ce2 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.061529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 108/216] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:43.061529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4933f02-49ff-4add-88dd-09793b735ce2 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.152674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66373a-568a-4491-ac37-1fe3707c30a3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.155143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4933f02-49ff-4add-88dd-09793b735ce2 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.184534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.185342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.185605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.185879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.187632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.188324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.188604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.188879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.189621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:43.189927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.191353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28fff0-3050-412e-b06e-88fef496e80c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.195472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:43.199645 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 109/217] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:43.202094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.202392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.202674 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:43.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:43.204463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:43.205254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 109/218] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:43.205927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.222815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:43.224015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:43.284975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 110/219] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:43.285727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.308707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7e79-6d84-450b-b3e9-da714ad620d0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.342172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.342970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.343292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.343580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.344748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.346200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.347853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 110/220] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:43.348616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.381288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6d1b-b973-444f-8b94-cd16f9b44734 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.413088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.413958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.414245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.414516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] PATH_INFO: `/v3/users/b68994b5ac9541309d530a2943478104` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.415737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] RBAC: Authorizing `identity:get_user(user_id=b68994b5ac9541309d530a2943478104)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.417213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.418839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 111/221] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/users/b68994b5ac9541309d530a2943478104 => generated 283 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:43.420193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.443060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f62e76-aafd-4d10-ac4a-6d949c5e1d00 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.475588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.476253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.476542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.476817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.477558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] RBAC: Adding query filter params (name=member) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:43.477862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.479290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.487171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 111/222] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:43.487716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.520675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09556e88-e1fc-4a2e-9438-e979678fc646 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.552994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.553748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.554032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.554308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.564616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:43.572784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:43.573651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:43.574419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 112/223] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:43.575193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.584813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75131d-ef6b-4eab-8092-afc38dc79802 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.616374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.617040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.617340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.617601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.618308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.620362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.638713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 112/224] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:43 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:43.639548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.677365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468c0d-6511-43ce-846a-ab8211fe348d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.716054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.716946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.717229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.717495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.718755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.720300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.722084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 113/225] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:43.722880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.751868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab41f39-0825-46c1-b845-ba88cace8b48 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.799150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.800052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.800343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.800618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] PATH_INFO: `/v3/users/36aff9f957964729b819b7d763b85382` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.816710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] RBAC: Authorizing `identity:get_user(user_id=36aff9f957964729b819b7d763b85382)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.818108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.819875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 113/226] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/users/36aff9f957964729b819b7d763b85382 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:43.824509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.835255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d317f3-74bc-4059-81a7-5436f3d16e0f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.870482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.871442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.871882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.872299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.875308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:43.875308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.875308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.882952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 114/227] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:43.883723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:43.927198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e752-f857-4c8e-8aa7-eec316574a42 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:43.967127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:43.968380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:43.968868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:43.969357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/b68994b5ac9541309d530a2943478104/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:43.972037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] RBAC: Authorizing `identity:create_grant(project_id=f381ba14dd384d0dae3ca3c5cf3603de, user_id=b68994b5ac9541309d530a2943478104, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:43.973720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:43.997526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd78d7-351b-4bc7-afec-d74c9f8bc6b6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:44.004302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 114/228] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:43 2022] PUT /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/b68994b5ac9541309d530a2943478104/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:44.004302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:44.038083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:44.038798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:44.039163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:44.039514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:44.113672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:44.114055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4d38-731d-4f4b-900f-7e38b24e084f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:44.115236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:44.150650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:44.151623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:44.151951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:44.152232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] PATH_INFO: `/v3/users/b68994b5ac9541309d530a2943478104` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:44.153526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] RBAC: Authorizing `identity:get_user(user_id=b68994b5ac9541309d530a2943478104)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:44.154997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:44.156990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 115/229] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:44 2022] GET /identity/v3/users/b68994b5ac9541309d530a2943478104 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:44.162611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:44.219546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 115/230] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:44.224960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:44.268865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e30aa-1a3b-4d05-805e-895702f54505 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:44.303858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:44.304776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:44.305068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:44.305347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:44.307191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:44.308681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:44.310598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 116/231] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:44 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:44.316345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:44.329902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffeeaa-8480-4c5e-a21d-95295066415d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:44.364554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:44.365288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:44.365566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:44.365838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:44.367033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:44.368518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:44.371088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 116/232] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:44 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:44.376995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:44.427744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab58a1-30f8-4722-aa05-e5d3dd647892 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:44.474820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f6afa-2da2-4961-aa43-387f4cc9d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:44.475786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6afa-2da2-4961-aa43-387f4cc9d42d None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:44.476072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6afa-2da2-4961-aa43-387f4cc9d42d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:44.476349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f6afa-2da2-4961-aa43-387f4cc9d42d None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/b68994b5ac9541309d530a2943478104/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:44.479203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f6afa-2da2-4961-aa43-387f4cc9d42d None admin] RBAC: Authorizing `identity:create_grant(project_id=f381ba14dd384d0dae3ca3c5cf3603de, user_id=b68994b5ac9541309d530a2943478104, role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:44.479387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b86b-0aaf-4b6e-a268-3611ec074d0a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:44.480837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f6afa-2da2-4961-aa43-387f4cc9d42d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:44.496282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 117/233] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:44 2022] PUT /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/b68994b5ac9541309d530a2943478104/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:28:44.520018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:44.520689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:44.520971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:44.521246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:44.522090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=36aff9f957964729b819b7d763b85382) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:44.522402 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:44.523939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615817d-23dc-42bf-a10c-5e93396da036 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:44.530199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 117/234] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:44 2022] GET /identity/v3/role_assignments?user.id=36aff9f957964729b819b7d763b85382&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=0770ca7325a8434d91507daed896ceb2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:46.396559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cd4fd-1842-4efa-bc95-3f3c37b1650e None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:46.397419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cd4fd-1842-4efa-bc95-3f3c37b1650e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:46.397831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cd4fd-1842-4efa-bc95-3f3c37b1650e None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:46.399617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 118/235] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:46.404639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:46.405414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:46.405833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:46.428585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:46.429987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:46.508834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 118/236] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:46.549405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cd4fd-1842-4efa-bc95-3f3c37b1650e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:46.674508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cd4fd-1842-4efa-bc95-3f3c37b1650e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:46.720624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a908d4-8f68-43fc-8653-00dd31d2a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:46.721651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a908d4-8f68-43fc-8653-00dd31d2a998 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:46.722095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a908d4-8f68-43fc-8653-00dd31d2a998 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:46.722504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a908d4-8f68-43fc-8653-00dd31d2a998 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:46.739978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a908d4-8f68-43fc-8653-00dd31d2a998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-f3a908d4-8f68-43fc-8653-00dd31d2a998 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:46.748460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:46.749541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:46.750499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:46.752772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 119/237] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:46.760515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:46.868056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb66d8-ef0f-4ffa-8799-e4e71aa862f1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:46.902974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:46.903929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:46.904377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:46.904793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:46.905680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:46.906123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:46.907664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:46.917000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 119/238] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:46.918209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018440-9d27-429c-8ad4-657cdaddb75b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:46.918460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018440-9d27-429c-8ad4-657cdaddb75b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:46.918877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a018440-9d27-429c-8ad4-657cdaddb75b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:46.920470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 120/239] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:46.928488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:46.931096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5641-5e20-4d0c-bba0-b473a0440b0b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:46.931707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5641-5e20-4d0c-bba0-b473a0440b0b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:46.932220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5641-5e20-4d0c-bba0-b473a0440b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:46.984307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-862c5641-5e20-4d0c-bba0-b473a0440b0b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:46.985830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-862c5641-5e20-4d0c-bba0-b473a0440b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:47.035245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd1db-7b77-48df-9ad6-6ea3f2fbc08e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.069991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.070880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.071184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.071456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] PATH_INFO: `/v3/users/50eeb778cca545adb7d7f643b100e8ad` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.085250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] RBAC: Authorizing `identity:get_user(user_id=50eeb778cca545adb7d7f643b100e8ad)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.086717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.089341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 120/240] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:46 2022] GET /identity/v3/users/50eeb778cca545adb7d7f643b100e8ad => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:47.099233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.130499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 121/241] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:47.131865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b79b-2597-4ebc-bcac-37f3c418e4e7 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.132154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b79b-2597-4ebc-bcac-37f3c418e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.132429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b79b-2597-4ebc-bcac-37f3c418e4e7 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.139511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 122/242] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:47.145048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6bf1d-4d08-4c7d-aeb7-57b2ce60768f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.145332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6bf1d-4d08-4c7d-aeb7-57b2ce60768f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.145611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6bf1d-4d08-4c7d-aeb7-57b2ce60768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.163725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-90c6bf1d-4d08-4c7d-aeb7-57b2ce60768f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:47.164898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-90c6bf1d-4d08-4c7d-aeb7-57b2ce60768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:47.215913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e4e6-936c-4775-9f04-a426f142dad6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.230124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 123/243] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:47.236877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c9e50-b8cd-43d1-86e1-ea649b9fad24 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.237611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c9e50-b8cd-43d1-86e1-ea649b9fad24 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.238091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c9e50-b8cd-43d1-86e1-ea649b9fad24 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.244741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 124/244] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:47 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:47.246352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c9e50-b8cd-43d1-86e1-ea649b9fad24 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.253330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.253993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.254278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.254552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.320231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.321699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.350912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c9e50-b8cd-43d1-86e1-ea649b9fad24 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.388054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dd08d-28f8-4c49-9bc2-ebc19fa12ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.388858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd08d-28f8-4c49-9bc2-ebc19fa12ccf None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.389135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd08d-28f8-4c49-9bc2-ebc19fa12ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.389407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd08d-28f8-4c49-9bc2-ebc19fa12ccf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.390562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dd08d-28f8-4c49-9bc2-ebc19fa12ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.392275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dd08d-28f8-4c49-9bc2-ebc19fa12ccf None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.398437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 125/245] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:47.398437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.398437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.398437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.414154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:47.415361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:47.422509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 121/246] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:47.423303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.488093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 126/247] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:47.489188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.531485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f80fa-975b-41eb-a86c-ecb4174cbef0 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.563880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.564763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.565047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.565319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.575396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:47.583018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:47.583899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:28:47.584689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:47.585285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6f8b6-b64c-4400-b3b9-e4664263d8db None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.585363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 122/248] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:47.585363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.620733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.621390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.621669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.621941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.622642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.624127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.643220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 127/249] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:47 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:47.644208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.685473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5214c35-5e60-4dfb-8075-0a697e2698a6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.722032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a922-b70c-40cd-86de-3a27919f330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.722926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a922-b70c-40cd-86de-3a27919f330e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.723246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a922-b70c-40cd-86de-3a27919f330e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.723526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a922-b70c-40cd-86de-3a27919f330e None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.724814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7a922-b70c-40cd-86de-3a27919f330e None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.726333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7a922-b70c-40cd-86de-3a27919f330e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.728163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 123/250] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:47.729500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d3ff6-f7b0-4dc4-a745-5b6e4b648773 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.729802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d3ff6-f7b0-4dc4-a745-5b6e4b648773 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.730082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d3ff6-f7b0-4dc4-a745-5b6e4b648773 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.731344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 124/251] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:47.732255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d3ff6-f7b0-4dc4-a745-5b6e4b648773 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.754907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bce5b-25cf-41a7-a09c-1185df29dd2c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.789496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.790321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.790647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.790993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.804101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:47.816351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:47.817332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:28:47.818119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:47.819662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 128/252] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:47.820316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:47.851720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d3ff6-f7b0-4dc4-a745-5b6e4b648773 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.888789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.889465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.890166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.890166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.890780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:47.891359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.892471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4719a3-7f19-4414-ae99-827482278182 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.902732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 125/253] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:47.907915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.908211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.908490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.930072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:47.932038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:47.933463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882d5f-0387-4767-95e7-b96f97524563 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:47.980259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:47.980958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:47.981247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:47.981529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:47.982378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] RBAC: Adding query filter params (role.id=b5c8440105d04cddbef10dd1db8181fa, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=50eeb778cca545adb7d7f643b100e8ad) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:47.982693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:47.984771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:47.990231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 129/254] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/role_assignments?user.id=50eeb778cca545adb7d7f643b100e8ad&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=b5c8440105d04cddbef10dd1db8181fa => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:47.991050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.021381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 126/255] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:48.022237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.121639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c57-c97c-4109-96be-51576d770346 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.149507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903497-38fd-4d71-97d3-cf6d72c2873c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.164768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.166554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.167014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.167634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.168973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:48.169470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:48.171082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:48.182119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 130/256] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:28:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:48.183422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.208245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.209201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.209560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.209932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] PATH_INFO: `/v3/users/b68994b5ac9541309d530a2943478104` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.211911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] RBAC: Authorizing `identity:get_user(user_id=b68994b5ac9541309d530a2943478104)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:48.213540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:48.216107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 127/257] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/users/b68994b5ac9541309d530a2943478104 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:48.216725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.300084 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64980b-946e-4087-9b32-cf007099199b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.338447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.339745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.340155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.340552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.352886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:48.362105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:48.363217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:48.364063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:48.366511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 131/258] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:48.367774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.387446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402dc86-f875-4519-b158-bc2e61e901ba None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.422035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.423059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.423630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.423713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] PATH_INFO: `/v3/users/b68994b5ac9541309d530a2943478104` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.424966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] RBAC: Authorizing `identity:get_user(user_id=b68994b5ac9541309d530a2943478104)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:48.426489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:48.428535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 128/259] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/users/b68994b5ac9541309d530a2943478104 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:48.429382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.489989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52e8c-12bb-47ec-9a83-a9718c25f965 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.528759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.529970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.530572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.531028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.541554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b30099-c607-4022-b39f-ee2f1d1362c5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.588220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.588840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.589128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.589418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.590179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:48.590493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:48.591922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:48.610445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:48.612396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:48.621127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 129/260] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:48.621998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.755368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 132/261] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:48.756242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:48.773425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e4b2f-03eb-4d86-b0cc-e51318888458 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:48.834999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:48.835684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:48.835970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:48.836248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:48.935349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:48.937198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:48.949250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc33165-2b05-42ae-bafc-1c0054399d78 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.025002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.027137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.027892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.028645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] PATH_INFO: `/v3/users/36aff9f957964729b819b7d763b85382` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.030214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] RBAC: Authorizing `identity:get_user(user_id=36aff9f957964729b819b7d763b85382)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.032548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.036587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 133/262] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/users/36aff9f957964729b819b7d763b85382 => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:49.037734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:49.077837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 130/263] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:49.078698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:49.145937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005374-0d88-4e7a-a65c-e8582bb627e8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.183775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.184970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.185506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.186099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.187547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.189188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.191425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 134/264] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:49 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:49.192765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:49.303140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce2eb-cf26-4267-91ec-0869cc3d5caa None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.321233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e907-b8d7-40ab-b5d2-9423668c6cf3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.343327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.344522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.344996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.345499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.346876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.348861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.350969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 135/265] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:49 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:49.351953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:49.408350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.409234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.409523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.409797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.412029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.413500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.415789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 131/266] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:49 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:49.416724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:49.469012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5888cb-f658-46d2-8644-ddcf0396c9e1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.502787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.504311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.504823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.505306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.506324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=b68994b5ac9541309d530a2943478104) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:49.506840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.508609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.515297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 136/267] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:49 2022] GET /identity/v3/role_assignments?user.id=b68994b5ac9541309d530a2943478104&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:49.516282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:49.614009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34bb9-fb30-4638-a317-4fa013102bdc None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.616825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c5aa-1311-43ca-8d3d-e610c6e4b33d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:49.652188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162b1d-7750-4f4d-a540-3132f46d8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.653425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162b1d-7750-4f4d-a540-3132f46d8a12 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.653900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162b1d-7750-4f4d-a540-3132f46d8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.654374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162b1d-7750-4f4d-a540-3132f46d8a12 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/36aff9f957964729b819b7d763b85382/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.656593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162b1d-7750-4f4d-a540-3132f46d8a12 None admin] RBAC: Authorizing `identity:create_grant(project_id=f381ba14dd384d0dae3ca3c5cf3603de, user_id=36aff9f957964729b819b7d763b85382, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.658232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162b1d-7750-4f4d-a540-3132f46d8a12 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.671254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:49.674921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:49.679014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 137/268] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:49 2022] PUT /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/36aff9f957964729b819b7d763b85382/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:49.679570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:49.680057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:49.681142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] RBAC: Adding query filter params (role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=b68994b5ac9541309d530a2943478104) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:49.682177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:49.683900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672083-70ce-45fa-a20e-4bb50f210325 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:49.690890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 132/269] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:49 2022] GET /identity/v3/role_assignments?user.id=b68994b5ac9541309d530a2943478104&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:50.476644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8deb8a-cc9a-4579-94eb-fa0a2a2a358c None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.477334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8deb8a-cc9a-4579-94eb-fa0a2a2a358c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.477920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8deb8a-cc9a-4579-94eb-fa0a2a2a358c None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.480697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 138/270] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:50.486989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2834e2-aff9-46ef-88ba-2b06abff35bf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.487662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2834e2-aff9-46ef-88ba-2b06abff35bf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.488142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2834e2-aff9-46ef-88ba-2b06abff35bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.506361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0d2834e2-aff9-46ef-88ba-2b06abff35bf None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:50.507965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0d2834e2-aff9-46ef-88ba-2b06abff35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:50.575474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 133/271] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:50.599507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8deb8a-cc9a-4579-94eb-fa0a2a2a358c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:50.648297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b068-3b36-469e-ab14-91ac9aa710fc None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.649233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b068-3b36-469e-ab14-91ac9aa710fc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.649733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b068-3b36-469e-ab14-91ac9aa710fc None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.652219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 134/272] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:50.658891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354e8b-4584-419e-8a3a-141126357ff5 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.659465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354e8b-4584-419e-8a3a-141126357ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.659937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354e8b-4584-419e-8a3a-141126357ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.677981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-db354e8b-4584-419e-8a3a-141126357ff5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:50.679521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-db354e8b-4584-419e-8a3a-141126357ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:50.711342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8deb8a-cc9a-4579-94eb-fa0a2a2a358c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:50.751173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 135/273] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:50.751340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:50.751340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.751340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.751340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.752604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f80007-a234-4193-9cc0-cda618b1ca87 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.752901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f80007-a234-4193-9cc0-cda618b1ca87 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.753185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f80007-a234-4193-9cc0-cda618b1ca87 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.754669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 136/274] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:50.760533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.761020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.761473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.764248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:50.772300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:50.773229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:50.774021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 139/275] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:50.776407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:50.782163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:50.783369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:50.855140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 137/276] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:50.855140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:50.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e99a-33c7-4531-a75d-104dc21f367c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:50.915692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:50.916480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.916763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.917040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.926712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:50.934326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:50.935529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 140/277] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:50.936336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:50.952688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf5be-0153-46e3-8fb2-f28c099a859a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:50.985388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:50.986059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:50.986341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:50.986616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:50.987399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:50.987704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:50.989096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.001603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 138/278] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.001603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.035458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d491c4-ab9b-4d3b-b2e5-61512548f7aa None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.067951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.068733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.069027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.069282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.070441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.072567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.078980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 141/279] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.078980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.096285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039366-d935-4c9f-9ef5-58cbdff5b080 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.129950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.130623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.130911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.131206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.131954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:51.132260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.133628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.146714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 139/280] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.146714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.178290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cab24c-d967-4b29-97db-38a2e61e4e26 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.210104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.210964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.211272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.211545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] PATH_INFO: `/v3/users/8efe549f7b604253983740c342415c98` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.224162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] RBAC: Authorizing `identity:get_user(user_id=8efe549f7b604253983740c342415c98)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.225613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.231912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 142/281] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:51 2022] GET /identity/v3/users/8efe549f7b604253983740c342415c98 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.231912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.236244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a931740-1878-44e1-a713-e8db26412307 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.268490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.269097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.269380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.269658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.270360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.271818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.298586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 140/282] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:28:51 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:51.298586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.329896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205adf-e233-4909-9cab-b4c9f42267ba None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.365926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.366807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.367085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.367383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] PATH_INFO: `/v3/users/50eeb778cca545adb7d7f643b100e8ad` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.369127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=50eeb778cca545adb7d7f643b100e8ad)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.370704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.372640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 143/283] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:51 2022] GET /identity/v3/users/50eeb778cca545adb7d7f643b100e8ad => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.380668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.404925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257cf01-8198-41b3-8902-7aa69f44295b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.441040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.441770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.442060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.442336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.443216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, user.id=8efe549f7b604253983740c342415c98, scope.system=all) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:51.443894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.444994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.451165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 141/284] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Apr 29 18:28:51 2022] GET /identity/v3/role_assignments?user.id=8efe549f7b604253983740c342415c98&scope.system=all&role.id=0770ca7325a8434d91507daed896ceb2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.510335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c674301-0273-4043-9a74-0d894afc7fa7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.549297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a2a4e-84e6-4067-bd09-d5e4eac5e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.550097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2a4e-84e6-4067-bd09-d5e4eac5e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.550375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2a4e-84e6-4067-bd09-d5e4eac5e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.550646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2a4e-84e6-4067-bd09-d5e4eac5e2b1 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.551924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a2a4e-84e6-4067-bd09-d5e4eac5e2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.553413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a2a4e-84e6-4067-bd09-d5e4eac5e2b1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.555522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 144/285] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:51 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:51.563025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:51.672874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebade9-0e49-45da-8037-7d4b38d26497 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:51.707722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24531a80-759f-4ffd-b140-6834619953d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:51.708993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24531a80-759f-4ffd-b140-6834619953d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:51.709470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24531a80-759f-4ffd-b140-6834619953d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:51.709934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24531a80-759f-4ffd-b140-6834619953d9 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/50eeb778cca545adb7d7f643b100e8ad/roles/b5c8440105d04cddbef10dd1db8181fa` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:51.712149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24531a80-759f-4ffd-b140-6834619953d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f381ba14dd384d0dae3ca3c5cf3603de, user_id=50eeb778cca545adb7d7f643b100e8ad, role_id=b5c8440105d04cddbef10dd1db8181fa)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:51.713847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24531a80-759f-4ffd-b140-6834619953d9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:51.733297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 142/286] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:28:51 2022] PUT /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/users/50eeb778cca545adb7d7f643b100e8ad/roles/b5c8440105d04cddbef10dd1db8181fa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:52.292256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1dbd-95bb-4b66-b54d-9aa6b285740a None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:52.292777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1dbd-95bb-4b66-b54d-9aa6b285740a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:52.292886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1dbd-95bb-4b66-b54d-9aa6b285740a None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:52.294416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 145/287] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:52.299929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:52.300295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:52.300649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:52.320743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:52.322467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:52.413714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 143/288] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:52.461125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1dbd-95bb-4b66-b54d-9aa6b285740a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:52.578428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1dbd-95bb-4b66-b54d-9aa6b285740a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:52.611609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:52.612419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:52.612703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:52.612982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:52.623904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:52.631573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:52.632458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:52.633259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 146/289] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:52.641112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:52.786963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd7e95-dd81-47db-9f20-a3392525adbf None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:52.834623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:52.835247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:52.835532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:52.835808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:52.836556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:52.836862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:52.838262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:52.846694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 144/290] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:52.852513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:52.981210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342fd1-376c-4245-ac5f-379ac64906d9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:53.014931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:53.015900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:53.016184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:53.016461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] PATH_INFO: `/v3/users/36aff9f957964729b819b7d763b85382` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:53.017659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] RBAC: Authorizing `identity:get_user(user_id=36aff9f957964729b819b7d763b85382)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:53.019136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:53.021116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 147/291] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:52 2022] GET /identity/v3/users/36aff9f957964729b819b7d763b85382 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:53.027129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:53.138696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f269-6d4d-42ca-882d-8049b805639b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:53.177222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:53.177879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:53.178171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:53.178435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:53.266394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:53.267872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:53.386793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 145/292] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:53.392692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:53.519307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da899a2-c46e-4b02-8e60-e30339b29efd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:53.559399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b01aa-7eea-480c-973b-d1975af8fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:53.560627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b01aa-7eea-480c-973b-d1975af8fda0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:53.561109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b01aa-7eea-480c-973b-d1975af8fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:53.561573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b01aa-7eea-480c-973b-d1975af8fda0 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:53.562955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b01aa-7eea-480c-973b-d1975af8fda0 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:53.564628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b01aa-7eea-480c-973b-d1975af8fda0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:53.566603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 148/293] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:53 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:53.573125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:53.720655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8865d8-fb5b-4cb8-a2a4-f7ad8800a363 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:53.756685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:53.757366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:53.757650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:53.757929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:53.758786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=36aff9f957964729b819b7d763b85382) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:53.759101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:53.761344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101916-048e-46c3-bac7-036b3ba36c76 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:53.769014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 146/294] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:53 2022] GET /identity/v3/role_assignments?user.id=36aff9f957964729b819b7d763b85382&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=0770ca7325a8434d91507daed896ceb2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:53.973738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0286-c2ea-4acf-b766-94fcd7d3ce42 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:53.974406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0286-c2ea-4acf-b766-94fcd7d3ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:53.974895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0286-c2ea-4acf-b766-94fcd7d3ce42 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:53.976973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 149/295] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:53.983415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab479-1e89-4125-848d-021a594234f0 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:53.984310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab479-1e89-4125-848d-021a594234f0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:53.984797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab479-1e89-4125-848d-021a594234f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.002733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-425ab479-1e89-4125-848d-021a594234f0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:54.004301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-425ab479-1e89-4125-848d-021a594234f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:54.073282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 147/296] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:54.096736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0286-c2ea-4acf-b766-94fcd7d3ce42 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.203641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0286-c2ea-4acf-b766-94fcd7d3ce42 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:54.239352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82467bc8-c1b1-40d1-bde5-ff835e9a0255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:54.240529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467bc8-c1b1-40d1-bde5-ff835e9a0255 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.241047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467bc8-c1b1-40d1-bde5-ff835e9a0255 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.241511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467bc8-c1b1-40d1-bde5-ff835e9a0255 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.252175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82467bc8-c1b1-40d1-bde5-ff835e9a0255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-82467bc8-c1b1-40d1-bde5-ff835e9a0255 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:54.260627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:54.261499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:54.262277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:54.264970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 150/297] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:28:54.271009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab479-1e89-4125-848d-021a594234f0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.314200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51880-3fd4-45d8-9366-7b6c74f786a7 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.314823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51880-3fd4-45d8-9366-7b6c74f786a7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.315340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51880-3fd4-45d8-9366-7b6c74f786a7 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.316962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 151/298] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:54.321880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.322400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.322870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.348104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:54.348490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:54.383617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab479-1e89-4125-848d-021a594234f0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:54.444942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 152/299] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:54.446325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:54.447827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.448316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.448784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.449883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:54.450400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:54.452171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:54.463338 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 148/300] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:54.468994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.476239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.578810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ad818-6aef-4ed9-981d-a9ee2957373b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:54.596054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa972e-7fd2-41fb-b3bd-daeb8c527ba6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:54.613359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce7675-4675-4654-917a-e67f4ac45137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:54.614221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7675-4675-4654-917a-e67f4ac45137 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.614495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7675-4675-4654-917a-e67f4ac45137 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.614760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7675-4675-4654-917a-e67f4ac45137 None admin] PATH_INFO: `/v3/users/8efe549f7b604253983740c342415c98` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.616086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce7675-4675-4654-917a-e67f4ac45137 None admin] RBAC: Authorizing `identity:get_user(user_id=8efe549f7b604253983740c342415c98)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:54.617529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce7675-4675-4654-917a-e67f4ac45137 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:54.623837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 153/301] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/users/8efe549f7b604253983740c342415c98 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:54.625098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e889d1-ad94-4f5b-867e-a8f940c570cf None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.625384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e889d1-ad94-4f5b-867e-a8f940c570cf None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.625657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e889d1-ad94-4f5b-867e-a8f940c570cf None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.626879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 154/302] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:54.627575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e889d1-ad94-4f5b-867e-a8f940c570cf None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.634875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba07b2-8270-47b9-913c-ac36603759db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:54.635743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba07b2-8270-47b9-913c-ac36603759db None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.636031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba07b2-8270-47b9-913c-ac36603759db None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.636310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba07b2-8270-47b9-913c-ac36603759db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.646414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba07b2-8270-47b9-913c-ac36603759db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-49ba07b2-8270-47b9-913c-ac36603759db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:54.654726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:54.655707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:54.656503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 149/303] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:54.657280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6096b8-d658-4309-bcf5-5b7cbe756818 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.657344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6096b8-d658-4309-bcf5-5b7cbe756818 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.657619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6096b8-d658-4309-bcf5-5b7cbe756818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.673240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1b6096b8-d658-4309-bcf5-5b7cbe756818 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:54.674406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1b6096b8-d658-4309-bcf5-5b7cbe756818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:54.728069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e889d1-ad94-4f5b-867e-a8f940c570cf None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:54.737125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 150/304] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:54.738385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38d905-00b9-48b7-ac0b-c8655cb0b3a3 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.738680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38d905-00b9-48b7-ac0b-c8655cb0b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.738961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38d905-00b9-48b7-ac0b-c8655cb0b3a3 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.740260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 151/305] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:54.740944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38d905-00b9-48b7-ac0b-c8655cb0b3a3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.765653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867af1-340b-4bdb-afd8-32e4819b0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:54.766511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867af1-340b-4bdb-afd8-32e4819b0798 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.766793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867af1-340b-4bdb-afd8-32e4819b0798 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.767072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867af1-340b-4bdb-afd8-32e4819b0798 None admin] PATH_INFO: `/v3/system/users/8efe549f7b604253983740c342415c98/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.768576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867af1-340b-4bdb-afd8-32e4819b0798 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8efe549f7b604253983740c342415c98, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:54.769978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867af1-340b-4bdb-afd8-32e4819b0798 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:54.778970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 155/306] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Apr 29 18:28:54 2022] PUT /identity/v3/system/users/8efe549f7b604253983740c342415c98/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:28:54.780343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.780606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.780890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.798785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:54.800039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:54.856834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38d905-00b9-48b7-ac0b-c8655cb0b3a3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:54.869795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 156/307] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:54.871069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.903096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:54.904589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:54.905125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:54.905552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:54.906952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:54.907714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:54.909371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:54.922079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 152/308] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:54.923921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:54.977611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680929d-b654-4b6f-a963-247ab0de120f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.011253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.012051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.012328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.012595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.013736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.015201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.017000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 157/309] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:55.017559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.038818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab126-ad50-4ccf-95a9-aada19085a05 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.072344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.073154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.073438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.073707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.083291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:55.090916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:55.091884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:28:55.092654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 153/310] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:55.093938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.116034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421db6c0-99dc-4fbd-b364-6d6d8d0ef051 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.149973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.150841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.151142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.151419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] PATH_INFO: `/v3/users/411261b57e274f8fbe322e1962167a43` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.164239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] RBAC: Authorizing `identity:get_user(user_id=411261b57e274f8fbe322e1962167a43)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.166459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.173043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 158/311] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:55 2022] GET /identity/v3/users/411261b57e274f8fbe322e1962167a43 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:55.174141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.191244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e789e-c2cd-4e86-8781-50013c1d2a58 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.222948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.223655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.223955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.224209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] PATH_INFO: `/v3/groups` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.224891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.226339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.241440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 154/312] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Apr 29 18:28:55 2022] POST /identity/v3/groups => generated 229 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:28:55.242328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.289615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eeb4c-6e2a-4732-a5de-dfc240dfc305 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.336165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.337759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.338505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.338963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.340133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:55.341020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.343137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.349568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ee59-9630-4245-9a7b-aad52333a4d4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.359798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 159/313] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:55.362941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.387589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.388176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.388459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.388735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.389603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] RBAC: Adding query filter params (role.id=b5c8440105d04cddbef10dd1db8181fa, user.id=411261b57e274f8fbe322e1962167a43, scope.system=all) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:55.389919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.391690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.407157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 155/314] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Apr 29 18:28:55 2022] GET /identity/v3/role_assignments?user.id=411261b57e274f8fbe322e1962167a43&scope.system=all&role.id=b5c8440105d04cddbef10dd1db8181fa => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:55.505256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf3137-7c39-446d-8f51-9208bf79cc65 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.543246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.544134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.544412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.544695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] PATH_INFO: `/v3/users/50eeb778cca545adb7d7f643b100e8ad` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.545918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] RBAC: Authorizing `identity:get_user(user_id=50eeb778cca545adb7d7f643b100e8ad)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.547525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.549522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 160/315] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:55 2022] GET /identity/v3/users/50eeb778cca545adb7d7f643b100e8ad => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:55.555203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.668358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a8585-e446-4f26-a77e-413f7d97bdf4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:55.701304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:55.701965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:55.702254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:55.702528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:55.770818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:55.772315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:55.869608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 156/316] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:28:55.876195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:55.976952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae6b97-1f85-4b4b-afc9-d0e1ee1e1f35 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:56.008777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaaf80-c09d-4cb0-b7f1-3b852e785c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:56.010710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaaf80-c09d-4cb0-b7f1-3b852e785c5a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:56.011224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaaf80-c09d-4cb0-b7f1-3b852e785c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:56.011696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaaf80-c09d-4cb0-b7f1-3b852e785c5a None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:56.013121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaaf80-c09d-4cb0-b7f1-3b852e785c5a None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:56.014835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaaf80-c09d-4cb0-b7f1-3b852e785c5a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:56.017085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 161/317] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:28:55 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:56.023048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:56.121692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c280e4-90e1-4703-9178-8923e42b6892 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:56.157625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:56.158651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:56.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:56.159643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:56.160728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] RBAC: Adding query filter params (role.id=b5c8440105d04cddbef10dd1db8181fa, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de, user.id=50eeb778cca545adb7d7f643b100e8ad) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:56.161288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:56.162945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150685-93ef-4024-8c1c-6302f29bdb69 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:56.169605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 157/318] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:28:56 2022] GET /identity/v3/role_assignments?user.id=50eeb778cca545adb7d7f643b100e8ad&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=b5c8440105d04cddbef10dd1db8181fa => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:57.064055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a60c2-d045-4475-a999-47ae2fd85946 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.064576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a60c2-d045-4475-a999-47ae2fd85946 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.064683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a60c2-d045-4475-a999-47ae2fd85946 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.066193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 162/319] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:57.072270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.072571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.072861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.092944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:57.094476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:57.161330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 158/320] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:57.184668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a60c2-d045-4475-a999-47ae2fd85946 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.281666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a60c2-d045-4475-a999-47ae2fd85946 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:57.313453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:57.314301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.314537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.314814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.324638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:57.332306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:57.333151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:28:57.333942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:57.335422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 163/321] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:57.339774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.441375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be0558-7d3b-44dd-9c96-01e524164d56 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:57.482874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:57.483620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.483892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.484169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.484922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:57.485230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:57.486599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc9f3b-5c5e-4c41-8305-0ae901ba874b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:57.499516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 159/322] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:57.500772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.598529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff5dbb-8b27-4eae-afc6-56575cabd8cc None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.598850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff5dbb-8b27-4eae-afc6-56575cabd8cc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.599085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff5dbb-8b27-4eae-afc6-56575cabd8cc None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.600604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 160/323] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:28:57.603636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2c54-dabc-4849-8781-3012b9c3e6e9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:57.605306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91a0ff-1e6e-4ec2-8b07-160a33321f0f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.605593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91a0ff-1e6e-4ec2-8b07-160a33321f0f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.605873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91a0ff-1e6e-4ec2-8b07-160a33321f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.622061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6a91a0ff-1e6e-4ec2-8b07-160a33321f0f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:57.623257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6a91a0ff-1e6e-4ec2-8b07-160a33321f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:57.636264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:57.637136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.637424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.637702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] PATH_INFO: `/v3/users/8efe549f7b604253983740c342415c98` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.638883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] RBAC: Authorizing `identity:get_user(user_id=8efe549f7b604253983740c342415c98)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:57.640356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:57.642135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 164/324] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:57 2022] GET /identity/v3/users/8efe549f7b604253983740c342415c98 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:57.647557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.688872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 161/325] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:28:57.704653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c8c1b-2d38-470d-a4af-18984e3cb693 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.704942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c8c1b-2d38-470d-a4af-18984e3cb693 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.705216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c8c1b-2d38-470d-a4af-18984e3cb693 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.706542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 162/326] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:28:57.710974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c8c1b-2d38-470d-a4af-18984e3cb693 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.741579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d8f3-7c99-42c0-afca-313d980e84d7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:57.776747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:57.777410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.777695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.777972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.779009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] RBAC: Adding query filter params (role.id=0770ca7325a8434d91507daed896ceb2, user.id=8efe549f7b604253983740c342415c98, scope.system=all) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:57.779348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:57.780782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8f05-4f3e-43d9-9761-ed92317829e9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:57.793236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 165/327] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Apr 29 18:28:57 2022] GET /identity/v3/role_assignments?user.id=8efe549f7b604253983740c342415c98&scope.system=all&role.id=0770ca7325a8434d91507daed896ceb2 => generated 510 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:57.794484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.794768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.795046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.812933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:28:57.813898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c8c1b-2d38-470d-a4af-18984e3cb693 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:57.814376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:28:57.849907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:57.850693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:57.851087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:57.851396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:57.852662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:57.854221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:57.861058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 163/328] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:57.862053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.890242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 166/329] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:28:57.913381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:57.966509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261197-1d42-4329-bb95-1d39bd01af41 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:58.003205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:58.003889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:58.004160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:58.004442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] PATH_INFO: `/v3/groups` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:58.005139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:58.006574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:58.019241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0794e7-57cb-4e96-adfe-a0b9200cd803 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:58.022844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 164/330] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Apr 29 18:28:57 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:28:58.054753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:58.055627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:58.056413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:58.056686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:58.068246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:28:58.076754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:28:58.077839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:28:58.078956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 167/331] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:28:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:28:58.084317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:58.191071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e428b2-0eab-4067-af31-e31345b6422b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:58.223447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:58.224131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:58.224409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:58.224684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:58.225441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:28:58.225746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:58.227130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:58.235620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 165/332] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:28:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:28:58.241286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:58.341872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dfeba-0fca-4a68-9454-cf3e35ccc899 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:58.375689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0e66-64a8-4bdb-9e0d-f1820e566f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:58.376575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0e66-64a8-4bdb-9e0d-f1820e566f4d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:58.376859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0e66-64a8-4bdb-9e0d-f1820e566f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:58.377138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0e66-64a8-4bdb-9e0d-f1820e566f4d None admin] PATH_INFO: `/v3/users/411261b57e274f8fbe322e1962167a43` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:58.378990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0e66-64a8-4bdb-9e0d-f1820e566f4d None admin] RBAC: Authorizing `identity:get_user(user_id=411261b57e274f8fbe322e1962167a43)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:58.380504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0e66-64a8-4bdb-9e0d-f1820e566f4d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:58.382170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 168/333] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:28:58 2022] GET /identity/v3/users/411261b57e274f8fbe322e1962167a43 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:28:58.388571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:28:58.499639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5aaff-080f-40b5-b252-432453c69b30 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:28:58.536012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca5975-46cb-4302-a3cd-23e199381567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:28:58.536012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5975-46cb-4302-a3cd-23e199381567 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:28:58.536012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5975-46cb-4302-a3cd-23e199381567 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:28:58.536012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5975-46cb-4302-a3cd-23e199381567 None admin] PATH_INFO: `/v3/system/users/411261b57e274f8fbe322e1962167a43/roles/b5c8440105d04cddbef10dd1db8181fa` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:28:58.536890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5975-46cb-4302-a3cd-23e199381567 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=411261b57e274f8fbe322e1962167a43, role_id=b5c8440105d04cddbef10dd1db8181fa)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:28:58.538291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5975-46cb-4302-a3cd-23e199381567 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:28:58.548552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 166/334] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Apr 29 18:28:58 2022] PUT /identity/v3/system/users/411261b57e274f8fbe322e1962167a43/roles/b5c8440105d04cddbef10dd1db8181fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:00.498484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f297a-02a1-4cfb-8f5b-0650803e101e None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:00.498992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f297a-02a1-4cfb-8f5b-0650803e101e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:00.499073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f297a-02a1-4cfb-8f5b-0650803e101e None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:00.500645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 169/335] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:00.506046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:00.506460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:00.506604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:00.525543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:00.526720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:00.593867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 167/336] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:00.617713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f297a-02a1-4cfb-8f5b-0650803e101e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:00.725421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f297a-02a1-4cfb-8f5b-0650803e101e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:00.758523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e4972-a249-4692-b5dc-4b13dc88c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:00.760134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4972-a249-4692-b5dc-4b13dc88c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:00.760413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4972-a249-4692-b5dc-4b13dc88c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:00.760686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4972-a249-4692-b5dc-4b13dc88c9b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:00.770975 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e4972-a249-4692-b5dc-4b13dc88c9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-f98e4972-a249-4692-b5dc-4b13dc88c9b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:00.779277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:00.781327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:00.783303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 170/337] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:00.787138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:00.885452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d694784-a167-4942-9d0b-74212a3cbbc4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:00.900004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14abf-a769-4dec-ab02-4813349c5698 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:00.900309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14abf-a769-4dec-ab02-4813349c5698 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:00.900562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14abf-a769-4dec-ab02-4813349c5698 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:00.902105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 171/338] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:00.908047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:00.908746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:00.909228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:00.930524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:00.931793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:00.932061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:00.932309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:00.933393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:00.933698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:00.935091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:00.938371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:00.939871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:00.948916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 168/339] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:00.954850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.055209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 172/340] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:01.094636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f442c-ceb2-4cb2-a4f7-604cc69dbfd8 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:01.138701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:01.139734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.140237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.140706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.174395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.217126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:01.218912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:01.321374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 169/341] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:01.328321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.406172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108ca9-cabb-40eb-a5c7-bdf3f892068a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:01.492753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd839f3-2beb-4fe6-adca-124f369b78cb None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:01.500504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:01.501320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.501606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.501882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.524239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:01.531688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:01.533230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.533717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.534190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.535626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:01.537301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:01.538327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:01.539243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:01.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:01.543945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 173/342] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:01.544674 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 170/343] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:01 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:01.547128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.551456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.710614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3712c3c-9e79-402d-b9fc-de681f6f6329 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:01.745225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416b8e-36cc-47e7-b979-054301abf541 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:01.746569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e4362-7867-4e28-909a-fd3c775643af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:01.747777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4362-7867-4e28-909a-fd3c775643af None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.748268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4362-7867-4e28-909a-fd3c775643af None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.748750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4362-7867-4e28-909a-fd3c775643af None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.755164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e4362-7867-4e28-909a-fd3c775643af None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:01.756877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e4362-7867-4e28-909a-fd3c775643af None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:01.758823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 171/344] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:01 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:01.760638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8cba-c0fa-4052-a47e-b31196fde6c2 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.761301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8cba-c0fa-4052-a47e-b31196fde6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.761781 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec8cba-c0fa-4052-a47e-b31196fde6c2 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.767584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 172/345] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:01.769441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8cba-c0fa-4052-a47e-b31196fde6c2 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.825147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:01.825855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.826138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.826416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.827231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:01.827546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:01.829009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fcba2-5fac-45cc-8ac6-7b024fec1af0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:01.846949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 174/346] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:01.848397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.848689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.848969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.880568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:01.881758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:01.889407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec8cba-c0fa-4052-a47e-b31196fde6c2 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:01.940635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:01.941667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:01.942176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:01.942659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:01.943823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:01.944341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:01.946001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:01.955232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 173/347] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:01 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=0770ca7325a8434d91507daed896ceb2 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:01.956410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:01.989481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 175/348] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:02.027008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.103140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ade1d-a619-4737-b481-7fb09a030a69 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.142816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44355a7-6978-40c3-bde3-fba7a65af1b5 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.151166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df08468-ea2d-44c5-bc4f-c5cb33ca0a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.152180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08468-ea2d-44c5-bc4f-c5cb33ca0a47 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.152673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08468-ea2d-44c5-bc4f-c5cb33ca0a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.153150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08468-ea2d-44c5-bc4f-c5cb33ca0a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.182852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64f054-ca94-47a8-bb25-d4fb1974da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.183708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f054-ca94-47a8-bb25-d4fb1974da7a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.183990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f054-ca94-47a8-bb25-d4fb1974da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.184268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f054-ca94-47a8-bb25-d4fb1974da7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.208183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64f054-ca94-47a8-bb25-d4fb1974da7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-1d64f054-ca94-47a8-bb25-d4fb1974da7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:02.223177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:02.224155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:02.225376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 176/349] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:02.226256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f66f-8f18-48d2-ab05-1df682ada375 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.226256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f66f-8f18-48d2-ab05-1df682ada375 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.226256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f66f-8f18-48d2-ab05-1df682ada375 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.229050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 177/350] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:02.237295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f66f-8f18-48d2-ab05-1df682ada375 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.284251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df08468-ea2d-44c5-bc4f-c5cb33ca0a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:02.285913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df08468-ea2d-44c5-bc4f-c5cb33ca0a47 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:02.433345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f66f-8f18-48d2-ab05-1df682ada375 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.443134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 174/351] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:02.444856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.445358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.445837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.469164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:02.470646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:02.479921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.480603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.480887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.481168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.481928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:02.482233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:02.483684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:02.492661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 178/352] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:02.494069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.553054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 175/353] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:02.554812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.598568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49132c7-bc4a-4481-b784-833e84c378ad None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.632424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.633293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.633573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.633853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.636336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:02.638046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:02.640310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 179/354] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:02.641226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.660816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47225dab-1c45-44ac-9ede-2d28edf93900 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.700749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75f011-c002-4fd7-bc5b-69cd742bf9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.701777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75f011-c002-4fd7-bc5b-69cd742bf9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.702255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75f011-c002-4fd7-bc5b-69cd742bf9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.702730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75f011-c002-4fd7-bc5b-69cd742bf9d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.746076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1bd91-0048-4e60-82fa-85c8d1d60a76 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.782037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.782840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.783154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.783437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.797596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:02.805806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:02.807401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 18:29:02.808358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:02.810823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 180/355] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:02.811833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.832049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75f011-c002-4fd7-bc5b-69cd742bf9d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:02.833762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75f011-c002-4fd7-bc5b-69cd742bf9d9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:02.916003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75f27b-c0b3-44e4-bd9b-a6fb70b50cd7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:02.939092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 176/356] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:02.940687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b5b3-e718-450a-b1f9-8ac49d4be617 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.941132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b5b3-e718-450a-b1f9-8ac49d4be617 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.941560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b5b3-e718-450a-b1f9-8ac49d4be617 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.943239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 177/357] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:02.944071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b5b3-e718-450a-b1f9-8ac49d4be617 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:02.950480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:02.951361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:02.951642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:02.951910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:02.953087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:02.954563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:02.956226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 181/358] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:02.956981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.066087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b5b3-e718-450a-b1f9-8ac49d4be617 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.087837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29773b9-0266-48b9-807a-cc7840c61ca1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.115012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.115976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.116597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.116883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.118061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:03.118595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:03.120624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b42808-5ee9-4f72-9803-5a7756baab70 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:03.128964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a6bda-4cbb-4f2e-a620-edbbfca35680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.129966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a6bda-4cbb-4f2e-a620-edbbfca35680 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.130084 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a6bda-4cbb-4f2e-a620-edbbfca35680 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.130361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a6bda-4cbb-4f2e-a620-edbbfca35680 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.131587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a6bda-4cbb-4f2e-a620-edbbfca35680 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:03.132586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 178/359] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:03.133117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a6bda-4cbb-4f2e-a620-edbbfca35680 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:03.133832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.134228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.134574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.139998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 182/360] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:02 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:03.139998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aec3-4086-4fae-be2d-0fcd2dc414c6 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.139998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aec3-4086-4fae-be2d-0fcd2dc414c6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.139998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aec3-4086-4fae-be2d-0fcd2dc414c6 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.139998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 183/361] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:03.140375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73aec3-4086-4fae-be2d-0fcd2dc414c6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.159744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:03.160318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:03.255199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 179/362] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:03.256508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.273648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73aec3-4086-4fae-be2d-0fcd2dc414c6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.315257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.315937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.316271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.317076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.317983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:03.318307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:03.319894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b139-ac46-4ae6-983c-cc6611b02114 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:03.327158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 184/363] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=0770ca7325a8434d91507daed896ceb2 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:03.329016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.329308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.329589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.351611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:03.353791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:03.382009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd3de7-aa84-401b-aa40-b19b0e80ed37 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.428576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.429221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 185/364] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:03.429435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.429716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.429988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] PATH_INFO: `/v3/users/411261b57e274f8fbe322e1962167a43` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.431133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.431331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] RBAC: Authorizing `identity:get_user(user_id=411261b57e274f8fbe322e1962167a43)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:03.432804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:03.439140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 180/365] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/users/411261b57e274f8fbe322e1962167a43 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:03.439140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.568949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e99d3-f0a0-4280-bfda-274f1e73a001 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.572805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71391e5-d965-4a27-a55f-fb1d3a9b1ac5 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.610798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.611024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.611670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.611957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.612236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.613283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.613764 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.614225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.616169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:03.617863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:03.620717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 186/366] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:03.622043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.623924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:03.632394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:03.633309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:03.635353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 181/367] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:03.636015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.752403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a1e0-7907-4525-9340-46c707095dbd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.764306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743724db-f91a-4676-bb16-ebe9a993c9c8 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:03.801289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.801639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.801840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.802119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.803007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] RBAC: Adding query filter params (role.id=b5c8440105d04cddbef10dd1db8181fa, user.id=411261b57e274f8fbe322e1962167a43, scope.system=all) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:03.803405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:03.804844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:03.811160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:03.812223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:03.812665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:03.813076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:03.823213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 187/368] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/role_assignments?user.id=411261b57e274f8fbe322e1962167a43&scope.system=all&role.id=b5c8440105d04cddbef10dd1db8181fa => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:03.823213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.841218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:03.849202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:03.850147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:03.851180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 182/369] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:03.860253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:03.975489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0bb2-5656-4782-95ca-bfb21a0b7bca None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.006182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9d1c-163e-4424-bad4-921ab9fe8dcb None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.008076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.008724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.009622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.013130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.013130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:04.013130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.013130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.019663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 188/370] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:04.020610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.054719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.055686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.056611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.057011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.057933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:04.058387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.059968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.074376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 183/371] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:04.079988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.132737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82191-d88d-4b85-852f-9238f015a642 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.175051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.176533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.176812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.177086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.177852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:04.178162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.179608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.202904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 189/372] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:04.212309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.256082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c1bc4-8b67-43e5-845f-8dcfb1c9a61c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.312513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.313478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.313944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.314421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.410139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.411815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.413292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021156-f4b7-4ab8-a6d4-3aaaa0d13d07 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.467031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.467031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.467031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.467031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.528581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 184/373] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 29 18:29:04.534573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.581730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.583236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.656959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bad6c-41e6-490b-9091-e8d39e6e4204 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.691787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.692756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.693434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.693717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.695450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.697237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.699726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 185/374] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:04.705609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.717589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 190/375] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:04.727126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.809038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05edaf2-35e3-41b0-9788-69a50022615d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.832507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470a67e-222f-498e-b840-b869a7aa90ac None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:04.848188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.849375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.849835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.850284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.851790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.854036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.856301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 186/376] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:04.863889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.892358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:04.893318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:04.893682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:04.894041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] PATH_INFO: `/v3/projects/c2ad2f44cc08416e8164cdae588a4916` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:04.900350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=c2ad2f44cc08416e8164cdae588a4916)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:04.901892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:04.904017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 191/377] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/projects/c2ad2f44cc08416e8164cdae588a4916 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:04.909482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:04.978287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c89d-6ad2-40d6-8ccf-fd8f1e0b1024 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.013952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.014963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.015492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.015999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.017041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:05.017552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.019326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021178ff-0293-4c58-9acf-6d463a736f96 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:05.026242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 187/378] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:05.030744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed9df-eff2-42d2-8003-e4cf46b8047a None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.031433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed9df-eff2-42d2-8003-e4cf46b8047a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.031915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed9df-eff2-42d2-8003-e4cf46b8047a None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.034019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 188/379] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:05.040755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb59d-384a-4516-851f-74952735516a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.041078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb59d-384a-4516-851f-74952735516a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.041324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb59d-384a-4516-851f-74952735516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.060922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0afbb59d-384a-4516-851f-74952735516a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:05.062880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0afbb59d-384a-4516-851f-74952735516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:05.085803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfbd2-e13b-4dab-b0ac-81495ff04dd6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.148449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 189/380] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:05.161114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.162294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.162719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.163178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] PATH_INFO: `/v3/groups/1c1ce01748814d0598ca5303878a70ac` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.170392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] RBAC: Authorizing `identity:get_group(group_id=1c1ce01748814d0598ca5303878a70ac)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.172147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:05.174395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 192/381] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:04 2022] GET /identity/v3/groups/1c1ce01748814d0598ca5303878a70ac => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:05.179994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb59d-384a-4516-851f-74952735516a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:05.192163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:05.304707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bc553-3563-40a8-8795-94b9cb00cca9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.350559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.351646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.352170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.352777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.354930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb59d-384a-4516-851f-74952735516a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.365187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:05.375674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:05.376610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:05.377401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:05.380159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 193/382] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:05.388103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:05.400957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.401970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.402427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.402971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.404040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] RBAC: Adding query filter params (group.id=1c1ce01748814d0598ca5303878a70ac, role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=c2ad2f44cc08416e8164cdae588a4916) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:05.404550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.406201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:05.412670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 190/383] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:05 2022] GET /identity/v3/role_assignments?group.id=1c1ce01748814d0598ca5303878a70ac&scope.project.id=c2ad2f44cc08416e8164cdae588a4916&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:05.500347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aec11-b1c7-412a-bac5-136853a2afa2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.537146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.537835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.538117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.538392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.539181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:05.539493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.540980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:05.550458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 194/384] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:05.556712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:05.661440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1d7d-2b32-4861-ab0a-9bafdce484cd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.696229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.697140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.697417 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.697689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.698871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.700351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:05.702257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 191/385] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:05 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:05.707766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:05.808048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391da7fb-fa46-4c53-a3b2-f97db0935dc6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.841092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9167b6-f20f-4e70-8d43-c4bcb1e18b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.841962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9167b6-f20f-4e70-8d43-c4bcb1e18b6d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.842241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9167b6-f20f-4e70-8d43-c4bcb1e18b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.842516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9167b6-f20f-4e70-8d43-c4bcb1e18b6d None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.843740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9167b6-f20f-4e70-8d43-c4bcb1e18b6d None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.845200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9167b6-f20f-4e70-8d43-c4bcb1e18b6d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:05.847188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 195/386] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:05 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:05.853600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:05.955622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae76b72-8865-4c5a-8ed6-0262221e4479 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:05.989337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909a02a-62b6-46ad-a558-c1dd4424be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:05.990223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909a02a-62b6-46ad-a558-c1dd4424be42 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:05.990502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909a02a-62b6-46ad-a558-c1dd4424be42 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:05.990774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909a02a-62b6-46ad-a558-c1dd4424be42 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:05.992777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909a02a-62b6-46ad-a558-c1dd4424be42 None admin] RBAC: Authorizing `identity:create_grant(project_id=4979d58f8832476ba4dc8c7f1d06aba4, group_id=ecc8229d26e14f45a75b031ff0ea4cb4, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:05.994783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909a02a-62b6-46ad-a558-c1dd4424be42 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:06.014152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 192/387] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Apr 29 18:29:05 2022] PUT /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:06.378695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025cbe2-72c5-4e2e-9886-3f7e33183075 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:06.379065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025cbe2-72c5-4e2e-9886-3f7e33183075 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:06.379286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025cbe2-72c5-4e2e-9886-3f7e33183075 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:06.380829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 196/388] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:06.386674 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:06.387235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:06.387722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:06.406167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:06.407771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:06.494637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 193/389] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:06.511739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025cbe2-72c5-4e2e-9886-3f7e33183075 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:06.620816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025cbe2-72c5-4e2e-9886-3f7e33183075 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:06.663919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:06.664653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:06.664940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:06.665256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:06.675841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:06.683598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:06.684499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:06.685714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 197/390] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:06.692510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:06.852390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d8cd-be1f-4148-9994-2fddf43cf91e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:06.887672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:06.888689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:06.889229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:06.889700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:06.890715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:06.891271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:06.892843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:06.907503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 194/391] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:06.910316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:07.024340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617236f-f0f9-4a84-bb60-efc2ef309163 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:07.059377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f119f32-6b6d-455d-9ea6-4b489a646c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:07.060633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119f32-6b6d-455d-9ea6-4b489a646c2b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.061164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119f32-6b6d-455d-9ea6-4b489a646c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.061660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f119f32-6b6d-455d-9ea6-4b489a646c2b None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.063038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f119f32-6b6d-455d-9ea6-4b489a646c2b None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:07.064730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f119f32-6b6d-455d-9ea6-4b489a646c2b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:07.071223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 198/392] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:06 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:07.073323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:07.152866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbd892-d40a-4b61-a743-f784e3ce3e0f None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.153510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbd892-d40a-4b61-a743-f784e3ce3e0f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.154002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbd892-d40a-4b61-a743-f784e3ce3e0f None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.155600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 199/393] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:07.160942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.161188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.161409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.188989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec83e3-8e4e-4be4-894a-ec65ce6ddfdd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:07.192291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:07.193412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:07.226063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:07.227379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.228410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.229277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.230854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:07.232515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:07.239185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 195/394] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:07 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:07.240837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:07.377700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 200/395] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:07.386498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75606b81-8fb0-44d5-956f-e8b748fd8554 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:07.434753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:07.435675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.435965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.436234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.440773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] RBAC: Authorizing `identity:create_grant(project_id=f381ba14dd384d0dae3ca3c5cf3603de, group_id=ecc8229d26e14f45a75b031ff0ea4cb4, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:07.446204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:07.452479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:07.463163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 196/396] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Apr 29 18:29:07 2022] PUT /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:29:07.623891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb9302-9a7b-4dac-a825-e86395b60856 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:07.667225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:07.667970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.668253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.668532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.681576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:07.689659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:07.690536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:07.691758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 201/397] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:07.697166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:07.800085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926cd6f-0a47-4f82-a6a9-f7f2e161aabe None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:07.836750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:07.837962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.838251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.838532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.839323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:07.839632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:07.841045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:07.849806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 197/398] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:07.855997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:07.958223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b91b4-d227-4005-aaff-25087aa99651 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:07.993408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:07.994267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:07.994556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:07.994836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:07.996051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:07.997650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:07.999631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 202/399] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:07 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:08.005945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:08.115620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772116a-a739-4f4e-b6f8-5f76ae84f7ee None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:08.160914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca201c0c-e5f8-4095-91ce-a9125b5980ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:08.161791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201c0c-e5f8-4095-91ce-a9125b5980ee None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.162080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201c0c-e5f8-4095-91ce-a9125b5980ee None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.162364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201c0c-e5f8-4095-91ce-a9125b5980ee None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.163621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201c0c-e5f8-4095-91ce-a9125b5980ee None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:08.165171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201c0c-e5f8-4095-91ce-a9125b5980ee None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:08.167264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 198/400] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:08 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:08.174402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:08.307157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aba32-21e8-4e65-89b6-e422e30874e0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:08.349733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fed21-baa3-48bf-969b-8a6b26ac3365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:08.351003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fed21-baa3-48bf-969b-8a6b26ac3365 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.351513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fed21-baa3-48bf-969b-8a6b26ac3365 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.352007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fed21-baa3-48bf-969b-8a6b26ac3365 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.357112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fed21-baa3-48bf-969b-8a6b26ac3365 None admin] RBAC: Authorizing `identity:create_grant(project_id=4979d58f8832476ba4dc8c7f1d06aba4, group_id=ecc8229d26e14f45a75b031ff0ea4cb4, role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:08.358925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fed21-baa3-48bf-969b-8a6b26ac3365 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:08.389783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 203/401] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Apr 29 18:29:08 2022] PUT /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:29:08.570153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a37a4-7e6c-4480-8db6-01b636724c1b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.570344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a37a4-7e6c-4480-8db6-01b636724c1b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.570623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a37a4-7e6c-4480-8db6-01b636724c1b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.573021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 199/402] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:08.578534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ae05-7216-4f7b-a9d0-4c65920f7c15 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.578847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ae05-7216-4f7b-a9d0-4c65920f7c15 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.579093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ae05-7216-4f7b-a9d0-4c65920f7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.600238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4ae0ae05-7216-4f7b-a9d0-4c65920f7c15 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:08.601444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4ae0ae05-7216-4f7b-a9d0-4c65920f7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:08.688802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 204/403] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:08.713901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a37a4-7e6c-4480-8db6-01b636724c1b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:08.803234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461493-de67-472f-82dd-f8ed4617c9c2 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.803552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461493-de67-472f-82dd-f8ed4617c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.803807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461493-de67-472f-82dd-f8ed4617c9c2 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.805515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 205/404] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:08.811363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.811647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.811924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.834394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:08.836107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:08.843598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a37a4-7e6c-4480-8db6-01b636724c1b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:08.894813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671635df-ee58-4133-a523-26611c155f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:08.895716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671635df-ee58-4133-a523-26611c155f58 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:08.895995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671635df-ee58-4133-a523-26611c155f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:08.896272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671635df-ee58-4133-a523-26611c155f58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:08.920024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671635df-ee58-4133-a523-26611c155f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-671635df-ee58-4133-a523-26611c155f58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:08.934953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:08.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:08.937162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 200/405] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:08.943135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671635df-ee58-4133-a523-26611c155f58 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:08.950386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 206/406] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:09.015402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.089898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671635df-ee58-4133-a523-26611c155f58 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.118712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e193b-ae52-44d0-be5b-48501ae4a311 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.129995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.130828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.131245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.132824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.133594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:09.133942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.135680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86815dab-f047-4dec-9e01-e30a831eeacb None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:09.143985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 201/407] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:09.145316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe01bef-9883-4df2-834e-7c3ab9630bb4 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.145608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe01bef-9883-4df2-834e-7c3ab9630bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.145885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe01bef-9883-4df2-834e-7c3ab9630bb4 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.151229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 202/408] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:09.151981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe01bef-9883-4df2-834e-7c3ab9630bb4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.159422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b59c-c7e6-4bd5-a934-777b07643c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.160464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b59c-c7e6-4bd5-a934-777b07643c0f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.160939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b59c-c7e6-4bd5-a934-777b07643c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.161402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b59c-c7e6-4bd5-a934-777b07643c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.175163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b59c-c7e6-4bd5-a934-777b07643c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-7eb3b59c-c7e6-4bd5-a934-777b07643c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:09.185567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:09.186429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:09.187318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:09.190426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 207/409] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:09.191771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.192211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.192620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.213315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:09.215234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:09.254052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe01bef-9883-4df2-834e-7c3ab9630bb4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.287812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.288817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.289205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.289583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.291435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.292974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:09.295198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 203/410] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:09.296118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.299368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 208/411] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:09.300342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.407667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f332c-d83e-4987-8b71-785c8c3be900 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.432453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921517b-20a4-4dc9-8271-1670fc7e4095 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.454062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.455512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.455999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.456459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.457829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.459559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:09.461917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 209/412] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:09.464088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.480147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.481102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.481533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.481980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.482983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:09.483449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.485009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:09.495815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 204/413] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:09.496861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.566687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f546a-9753-4b43-a0a1-e5e81571cba5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.601150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.601945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.602224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.602537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.606164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04a32a-b33b-4456-a902-aa1dc3235c27 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.612876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:09.620639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:09.621738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:09.622765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:09.626570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 210/414] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:09.627432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.648754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.650968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.651509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.652221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.655515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f381ba14dd384d0dae3ca3c5cf3603de, group_id=ecc8229d26e14f45a75b031ff0ea4cb4, role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.658011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:09.674958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 205/415] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Apr 29 18:29:09 2022] PUT /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de/groups/ecc8229d26e14f45a75b031ff0ea4cb4/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:09.676256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.775454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8056-2829-4697-90f8-acc1a48b377b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.790042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb70d53-9e19-4d75-9942-ed4a6fe89ae5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:09.833123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.834055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:09.835472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.836050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:09.836478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.836973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:09.837440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.838733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:09.838912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:09.840139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.843642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:09.863743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 206/416] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:09.869206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:09.961054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:09.962525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.032770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ed29-3ae1-4d97-a722-5aa9725b8e88 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.072046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.072921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.073204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.073541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] PATH_INFO: `/v3/groups/1c1ce01748814d0598ca5303878a70ac` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.074779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] RBAC: Authorizing `identity:get_group(group_id=1c1ce01748814d0598ca5303878a70ac)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.076294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.078238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 207/417] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/groups/1c1ce01748814d0598ca5303878a70ac => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:10.084454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.095290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 211/418] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:10.104178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.193714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b17457-6213-450e-a3e6-879051d33817 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.230878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771332-dfc8-4c58-b125-f0425bd6f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.231968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771332-dfc8-4c58-b125-f0425bd6f89d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.232409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771332-dfc8-4c58-b125-f0425bd6f89d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.232694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771332-dfc8-4c58-b125-f0425bd6f89d None admin] PATH_INFO: `/v3/projects/c2ad2f44cc08416e8164cdae588a4916` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.234489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c771332-dfc8-4c58-b125-f0425bd6f89d None admin] RBAC: Authorizing `identity:get_project(project_id=c2ad2f44cc08416e8164cdae588a4916)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.236438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c771332-dfc8-4c58-b125-f0425bd6f89d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.239275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 208/419] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/projects/c2ad2f44cc08416e8164cdae588a4916 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:10.240486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192732c-cb27-4529-a63b-50095186d7be None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.240772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192732c-cb27-4529-a63b-50095186d7be None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.241049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192732c-cb27-4529-a63b-50095186d7be None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.246898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 209/420] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:10.247757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192732c-cb27-4529-a63b-50095186d7be None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.289219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733023ac-2b55-4391-afb3-9eccd55586d2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.324181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334c0e9-6d0a-40fc-9b79-7a6a5ed655b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.325047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334c0e9-6d0a-40fc-9b79-7a6a5ed655b6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.325355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334c0e9-6d0a-40fc-9b79-7a6a5ed655b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.325588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334c0e9-6d0a-40fc-9b79-7a6a5ed655b6 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.326773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334c0e9-6d0a-40fc-9b79-7a6a5ed655b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.328323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334c0e9-6d0a-40fc-9b79-7a6a5ed655b6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.330383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 212/421] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:10.331688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.331977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.332256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.349250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:10.350263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:10.377913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192732c-cb27-4529-a63b-50095186d7be None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.423148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 213/422] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:10.423148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.429320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.430384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.431411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.433291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] PATH_INFO: `/v3/projects/c2ad2f44cc08416e8164cdae588a4916/groups/1c1ce01748814d0598ca5303878a70ac/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.437242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2ad2f44cc08416e8164cdae588a4916, group_id=1c1ce01748814d0598ca5303878a70ac, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.440128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.460479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 210/423] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Apr 29 18:29:10 2022] PUT /identity/v3/projects/c2ad2f44cc08416e8164cdae588a4916/groups/1c1ce01748814d0598ca5303878a70ac/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:10.467136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.548631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e8a7-3bfe-471b-b385-85e0926aad70 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.598288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.599191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.599474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.599744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.604273 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.605760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.613468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 214/424] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:10.619793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.696413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15ce4-a6af-4732-ae67-376d551f2232 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.739460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.740328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.740614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.740891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.754242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:10.764779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:10.765683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:10.766483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 211/425] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:10.772380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:10.777156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5bb0-2e3c-41c1-b7d7-dcd0f3581674 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.815810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.816398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.816683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.816968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.817853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:10.818610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.820517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.828516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 215/426] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=0770ca7325a8434d91507daed896ceb2 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:10.912894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f21889-cd93-4e00-844f-be26509cbec8 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:10.965543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:10.966607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:10.967094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:10.967624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:10.968591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] RBAC: Adding query filter params (name=member) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:10.969099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:10.970719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce2fb4-2a08-4677-a6f0-673e3771553e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:10.987484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 212/427] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:10.993148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.134440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cb66-d82e-4cda-8517-8586cbbd6f20 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.169487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.170142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.170426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.170705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.183209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e49fe-a594-4939-8879-eef10c6a7633 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.183786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e49fe-a594-4939-8879-eef10c6a7633 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.184271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e49fe-a594-4939-8879-eef10c6a7633 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.185830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 213/428] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:11.190890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.192756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.192756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.209271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:11.210465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:11.255860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:11.257321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:11.303534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 214/429] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:11.338677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.376881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 216/430] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:11.383262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.464235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600252-dca8-459b-a8eb-56e68ef762d7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.502256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4f87-c4e6-4574-9cc3-4707a4cf4c4e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.510824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.511118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.511430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.511707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.524707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:11.532816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:11.533912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:11.534770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 215/431] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:11.539538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.545394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.546258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.546657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.546940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.548168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:11.549625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:11.552475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 217/432] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:11 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:11.559026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.652203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6fa69-7674-40ae-a1d7-eb28105b9b4d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.659627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ef60b-9d67-4178-8aa8-fe9813c73ffe None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.690310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.691228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.691616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.692207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.692929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:11.693262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:11.694718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:11.697278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.698338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.698759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.699214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.700541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:11.702222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:11.704280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 216/434] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:11.704477 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 218/434] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:11 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:11.709449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.710534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:11.811846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359eedf-fe7e-4560-850b-678d1fa0fc93 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.812496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976f2f-61f8-4bb3-8223-4f71107d48c2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:11.846834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.847666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.848118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.848573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.849294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:11.850103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:11.850459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:11.850803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:11.851783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=0770ca7325a8434d91507daed896ceb2, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:11.852158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:11.855209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:11.862032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 219/435] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:11 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=0770ca7325a8434d91507daed896ceb2 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:11.927919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:11.930218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:12.038327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 217/436] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:12.044546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:12.154726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7679-73d9-484f-bdb8-0f9278f4021a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:12.188713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:12.189597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.189865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.190137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] PATH_INFO: `/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.191508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] RBAC: Authorizing `identity:get_project(project_id=4979d58f8832476ba4dc8c7f1d06aba4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:12.192981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:12.199245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 220/437] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:12 2022] GET /identity/v3/projects/4979d58f8832476ba4dc8c7f1d06aba4 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:12.200961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:12.301766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23893622-e460-4904-b6c8-4e901174bc92 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:12.332995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6849992-7552-456b-9d9f-96b1f9bd72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:12.333861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849992-7552-456b-9d9f-96b1f9bd72ea None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.334144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849992-7552-456b-9d9f-96b1f9bd72ea None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.334419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849992-7552-456b-9d9f-96b1f9bd72ea None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.335630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6849992-7552-456b-9d9f-96b1f9bd72ea None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:12.337611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6849992-7552-456b-9d9f-96b1f9bd72ea None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:12.345501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 218/438] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:12 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:12.345655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:12.369215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321b22e-bcde-4821-9a46-2065527c4270 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.369513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321b22e-bcde-4821-9a46-2065527c4270 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.369784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321b22e-bcde-4821-9a46-2065527c4270 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.371294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 219/439] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:12.376026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.376319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.376604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.393144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:12.394343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:12.448651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c618a3-6648-453f-a368-388b80a47de0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:12.463175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 220/440] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:12.484422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:12.486010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:12.486660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.486939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.487240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.488076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:12.488386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:12.489839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:12.495840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 221/441] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:12 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=4979d58f8832476ba4dc8c7f1d06aba4&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:12.601449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a93b5-a411-4482-8da6-ad94fcf2e80e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:12.637053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:12.637894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.638176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.638450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.650038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:12.658335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:12.659581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:12.660371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:12.664461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 221/442] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:12.665911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:12.769812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590428eb-263b-4cef-b2e4-b849f89654a6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:12.805986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:12.806667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.806958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.807270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:12.808024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:12.808335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:12.809728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8f2d-796f-437f-8887-67c7bef89c23 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:12.818443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 222/443] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:12.824866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:12.932533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526abb-48d6-4b57-9ae1-dff2c32a338f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:12.967074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:12.967770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:12.968058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:12.968335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.026147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b192-6f79-493a-955a-696bd51df542 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.026440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b192-6f79-493a-955a-696bd51df542 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.026617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b192-6f79-493a-955a-696bd51df542 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.028017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 223/444] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:13.033030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.033308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.033587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.035888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.037366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.051446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:13.052625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:13.117538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 224/445] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:13.136266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 222/446] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:13.137436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.141603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.229074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa163de-dc5e-4889-98f9-e06c0a863503 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.232406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d99801-ace7-40b8-a98c-a3fc10a716db None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.264838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.265695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.265884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.265990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.266231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] PATH_INFO: `/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.266675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.266955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.267258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.267421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] RBAC: Authorizing `identity:get_project(project_id=f381ba14dd384d0dae3ca3c5cf3603de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.268864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.270542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 225/447] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/projects/f381ba14dd384d0dae3ca3c5cf3603de => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:13.275851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.277270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:13.284810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:13.285884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:13.286808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 223/448] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:13.292070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.368561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3852b-8bb0-42a0-8a29-1bad68277346 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.384297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075334fb-cf2b-43d5-be25-2fa9b0bf8970 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.399393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.400230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.400506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.400775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] PATH_INFO: `/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.401918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] RBAC: Authorizing `identity:get_group(group_id=ecc8229d26e14f45a75b031ff0ea4cb4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.403370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.405114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 226/449] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/groups/ecc8229d26e14f45a75b031ff0ea4cb4 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:13.410568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.416526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.417194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.417479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.417761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.418503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:13.418812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.420203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.428007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 224/450] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:13.433753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.502668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00d1fd-a029-4995-840a-b61cfc5d5ad2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.526966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69d66f-0c8b-4443-b9f1-fed249684bf8 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.534239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.535301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.535792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.536290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.537860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] RBAC: Adding query filter params (group.id=ecc8229d26e14f45a75b031ff0ea4cb4, role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:13.538433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.540794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.547040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 227/451] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/role_assignments?group.id=ecc8229d26e14f45a75b031ff0ea4cb4&scope.project.id=f381ba14dd384d0dae3ca3c5cf3603de&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:13.565511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.566518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.566954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.567415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.643553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.645071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.743236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 225/452] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 29 18:29:13.748891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.846247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ce386-c1a7-4500-9d1a-8788ee781682 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:13.885181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:13.886046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:13.886322 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:13.886595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] PATH_INFO: `/v3/projects/c2ad2f44cc08416e8164cdae588a4916` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:13.887819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] RBAC: Authorizing `identity:get_project(project_id=c2ad2f44cc08416e8164cdae588a4916)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:13.889259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:13.890968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 228/453] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/projects/c2ad2f44cc08416e8164cdae588a4916 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:13.896597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:13.990680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dcd5-4021-4d64-b547-7f42eaa1bbb3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:14.022918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52378c70-01cb-4bea-a652-3c63690dc139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:14.023793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378c70-01cb-4bea-a652-3c63690dc139 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:14.024072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378c70-01cb-4bea-a652-3c63690dc139 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:14.024895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378c70-01cb-4bea-a652-3c63690dc139 None admin] PATH_INFO: `/v3/groups/1c1ce01748814d0598ca5303878a70ac` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:14.026049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52378c70-01cb-4bea-a652-3c63690dc139 None admin] RBAC: Authorizing `identity:get_group(group_id=1c1ce01748814d0598ca5303878a70ac)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:14.027502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52378c70-01cb-4bea-a652-3c63690dc139 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:14.029108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 226/454] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Apr 29 18:29:13 2022] GET /identity/v3/groups/1c1ce01748814d0598ca5303878a70ac => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:14.034961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:14.124868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c0bc4-670e-4131-8105-4e8137ed90d0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:14.156386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:14.157009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:14.157289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:14.157561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:14.158376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] RBAC: Adding query filter params (group.id=1c1ce01748814d0598ca5303878a70ac, role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=c2ad2f44cc08416e8164cdae588a4916) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:14.158682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:14.160120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2238f2-941b-4eaf-8cf7-392ac0200d49 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:14.166006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 229/455] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Apr 29 18:29:14 2022] GET /identity/v3/role_assignments?group.id=1c1ce01748814d0598ca5303878a70ac&scope.project.id=c2ad2f44cc08416e8164cdae588a4916&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 611 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:16.938201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b576e46-2e61-41f4-8058-48e53eca081d None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:16.939229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b576e46-2e61-41f4-8058-48e53eca081d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:16.939789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b576e46-2e61-41f4-8058-48e53eca081d None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:16.941614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 227/456] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:16.947317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:16.948139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:16.948618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:16.976109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:16.977702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:17.034117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de33c-07d7-4fab-aebc-b635e487fb73 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.034726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de33c-07d7-4fab-aebc-b635e487fb73 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.035250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de33c-07d7-4fab-aebc-b635e487fb73 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.036823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 228/457] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:17.044505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.045034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.045506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.063449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 230/458] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:17.069012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:17.070206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:17.100134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.157969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 229/459] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:17.186091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.251336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3433f-e3e3-4daf-ba55-e685b6b4d246 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.289596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.290653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.291063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.292158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.317315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.319045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.338506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecf8c7-c97c-4472-bdee-a3cc2e0c84af None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-46941bb5-5d06-48e5-8a4f-ac58b0f47f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:17.349087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:17.350130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:17.351177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:17.351177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:17.351177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:17.351177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:17.359557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 231/460] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:17.362538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040e93-0a19-4da7-ad7a-fcbdf9af004d None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.362820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040e93-0a19-4da7-ad7a-fcbdf9af004d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.363272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040e93-0a19-4da7-ad7a-fcbdf9af004d None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.365201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 232/461] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:17.366101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040e93-0a19-4da7-ad7a-fcbdf9af004d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.384679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.386025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.386310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.386586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.398836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.400548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-b7a6e8b9-fe33-4748-a3c6-adeb751a7bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:17.422842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:17.423924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:17.424982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:17.424982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:17.424982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:17.424982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:17.427297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 230/462] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:17.428827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.429246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.429648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.453222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:17.455609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:17.491836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040e93-0a19-4da7-ad7a-fcbdf9af004d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.526622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.527720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.528222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.528692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.529610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:17.530110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.531753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.543193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 231/463] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:17.544406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.552697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 233/464] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:17.558675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.662257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1d4ab-c386-45de-859c-3ef03282c488 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.671268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3bd05-c2ed-46af-a656-583c73467db8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.697196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.697892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.698301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.698585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.699397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:17.699986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.701683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.712644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.713663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.714149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.714622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.714824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 232/465] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:17.715684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.715994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.717820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.747283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 234/466] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:29:17 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:29:17.748585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.822249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482ebe2-ce4b-4fb9-af88-7b5f89a5f53c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.860800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.861958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.862508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.862996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.881662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.883647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.889946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc085277-2cdc-4e34-9222-c838b246071f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-15a4da51-7ad8-45ad-bd50-2fd7210ef60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:17.918168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:17.919088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:17.920047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:17.920047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:17.920047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:17.920047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:17.927788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 233/467] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:17.927788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ff0f3-f6e3-4713-97ca-cc977fa0068d None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.927788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ff0f3-f6e3-4713-97ca-cc977fa0068d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.927788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ff0f3-f6e3-4713-97ca-cc977fa0068d None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.927788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 234/468] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:17.931094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ff0f3-f6e3-4713-97ca-cc977fa0068d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:17.940751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a9d03-5140-4120-918c-991f3edef09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:17.941644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a9d03-5140-4120-918c-991f3edef09f None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.942038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a9d03-5140-4120-918c-991f3edef09f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.942424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a9d03-5140-4120-918c-991f3edef09f None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.943407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a9d03-5140-4120-918c-991f3edef09f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:17.945682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a9d03-5140-4120-918c-991f3edef09f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:17.968905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 235/469] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:29:17 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:17.971491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:17.971904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:17.972370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:17.992179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:17.994363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:18.056193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ff0f3-f6e3-4713-97ca-cc977fa0068d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.073700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 236/470] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:18.094271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.095345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.095780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.096202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.097096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:18.097571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:18.099174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:18.102870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:18.113536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 235/471] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:18.119406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:18.223396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc363fc-0b73-4ce1-a75c-6b01e0492e84 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.248172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4d674-3e9a-4046-b7b2-07dd25eeab8d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.266849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.267910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.268340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.268786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.281036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:18.282498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:18.291734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a594632-e01c-4808-aa00-65affaf0a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.292484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a594632-e01c-4808-aa00-65affaf0a9b4 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.292688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a594632-e01c-4808-aa00-65affaf0a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.292959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a594632-e01c-4808-aa00-65affaf0a9b4 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.293659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a594632-e01c-4808-aa00-65affaf0a9b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:18.295665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a594632-e01c-4808-aa00-65affaf0a9b4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e54edb25-b785-4c20-bbc3-4d316007d21f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:18.305329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:18.306228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:18.307081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:18.307081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:18.307081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:18.307081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:18.309465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 237/472] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:18.311034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47db3b-8022-460e-bb55-325cb5285467 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.311542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47db3b-8022-460e-bb55-325cb5285467 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.312082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47db3b-8022-460e-bb55-325cb5285467 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.313897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 238/473] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:18.317172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47db3b-8022-460e-bb55-325cb5285467 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:18.326259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 236/474] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:29:18 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:29:18.335794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144856c-3792-4c44-a56c-053f389b957b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.335794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144856c-3792-4c44-a56c-053f389b957b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.335794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144856c-3792-4c44-a56c-053f389b957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.371376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6144856c-3792-4c44-a56c-053f389b957b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:18.374213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6144856c-3792-4c44-a56c-053f389b957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:18.495943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47db3b-8022-460e-bb55-325cb5285467 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.522997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 237/475] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:18.548797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.550673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.550673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.550673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.550923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:18.551146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:18.553449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:18.565095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 239/476] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:18.569047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144856c-3792-4c44-a56c-053f389b957b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:18.572759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:18.670578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144856c-3792-4c44-a56c-053f389b957b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.671854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542481f-f6e0-4121-84f0-1055d5bffde9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.704658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.705434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.705717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.705988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.706490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.706740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:18.707654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.708244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.708747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.709116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:18.709856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:18.713531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:18.716145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.sql.core [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 29 18:29:18.716145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 29 18:29:18.716145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [parameters: {'id': 'fe2632171d7249a591ca9da59a9826d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 29 18:29:18.716145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80123) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application conn.query(q) Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result.read() Apr 29 18:29:18.734259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return ref.to_dict() Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 18:29:18.735322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application next(self.gen) Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application yield resource Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application next(self.gen) Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.session.rollback() Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.force_reraise() Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise self.value Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application session.commit() Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 29 18:29:18.736575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._prepare_impl() Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.session.flush() Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._flush(objects) Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application compat.raise_( Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application flush_context.execute() Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rec.execute(self) Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 29 18:29:18.737422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 18:29:18.738274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application conn.query(q) Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result.read() Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 18:29:18.739091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [parameters: {'id': 'fe2632171d7249a591ca9da59a9826d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:18.742797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 29 18:29:18.745550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:18.747679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 238/477] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Apr 29 18:29:18 2022] POST /identity/v3/roles => generated 144 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:18.747679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:18.748021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 240/478] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:29:18 2022] POST /identity/v3/users => generated 249 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:18.856436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbdd79-e57b-4e32-a2dd-b00aac4dda75 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:18.893715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5a84d-d349-42f5-8fcc-bdc7cf3974b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:18.894548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a84d-d349-42f5-8fcc-bdc7cf3974b6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:18.894853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a84d-d349-42f5-8fcc-bdc7cf3974b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:18.895164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a84d-d349-42f5-8fcc-bdc7cf3974b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:18.906871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5a84d-d349-42f5-8fcc-bdc7cf3974b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-aec5a84d-d349-42f5-8fcc-bdc7cf3974b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:18.915461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:18.917893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:18.919584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 239/479] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:18.925719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:19.031135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb404-e242-4eba-b907-2500ff593a49 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:19.064073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:19.064753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:19.065042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:19.065321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:19.066073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:19.066381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:19.067802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d711d-9656-4471-82d0-9edd5dbf8b54 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:19.076591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 241/480] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:20.686799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee4063-4feb-4b33-b981-40dd8c216a4c None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:20.687843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee4063-4feb-4b33-b981-40dd8c216a4c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:20.688329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee4063-4feb-4b33-b981-40dd8c216a4c None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:20.690118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 240/481] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:20.695660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:20.696512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:20.696989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:20.707722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513b7bc-73c2-4251-956b-79e0b2e1a8c5 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:20.708017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513b7bc-73c2-4251-956b-79e0b2e1a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:20.708305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513b7bc-73c2-4251-956b-79e0b2e1a8c5 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:20.709891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 241/482] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:20.715833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:20.716058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:20.719130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:20.726353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:20.728334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:20.747385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:20.748563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:20.827345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 242/483] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:20.861745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 242/484] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:20.863767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:20.887991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:20.985172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02bba1-bf1c-45e9-8496-00034324ba55 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.038138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.038958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.039269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.039545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.072059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:21.095136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:21.096071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:21.096845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 243/485] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:21.098804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.142997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb17da-57bd-4d87-9cfd-17f20a8cd060 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.202325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.204075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.205346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.206095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.229071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:21.247139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:21.248045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:21.248832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:21.256061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 243/486] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:21.263255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.341952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f709ff-8654-47d2-83e8-00a5aeea13ab None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.452011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.452699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.453361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.453361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.453993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:21.454296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:21.455832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7ec53-e7e6-4664-a761-14d3473676b4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:21.472083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30b18-c9c5-4488-8e75-e028c350ac95 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.485421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 244/487] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:21.487181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a10a1-0536-44ee-ba57-b1f5a36b20c8 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.487683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a10a1-0536-44ee-ba57-b1f5a36b20c8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.488152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a10a1-0536-44ee-ba57-b1f5a36b20c8 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.495432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 245/488] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:21.495432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a10a1-0536-44ee-ba57-b1f5a36b20c8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.529961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.530611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.530896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.531269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.532219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:21.532538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:21.534508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f2fc-49c2-45f7-8e27-bff7948b003d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:21.544149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 244/489] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:21.545518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.545813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.546095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.565130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:21.566328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:21.632118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a10a1-0536-44ee-ba57-b1f5a36b20c8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.643130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 245/490] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:21.643130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.690343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.691551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.692030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.692511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.704023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:21.705472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:21.723520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:21.724415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:21.725250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:21.725250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:21.725250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:21.725250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:21.725250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 246/491] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:21.725505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.743434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05033f-71a3-4fea-b641-cc023fc9f036 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.777115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.777911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.778194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.778466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.788506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:21.789947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-e6950981-5148-45c3-a6a7-9822112520b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:21.807329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:21.808257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 246/492] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9065-f956-4a0c-abc0-d78766fa3061 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9065-f956-4a0c-abc0-d78766fa3061 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9065-f956-4a0c-abc0-d78766fa3061 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.817256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 247/493] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:21.817753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d9065-f956-4a0c-abc0-d78766fa3061 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.835483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83015cb-fc57-444f-afca-4bfc0084c433 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.869917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.870708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.870987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.871291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.881329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:21.891938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:21.892847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 247/494] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:21.898772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:21.919495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d9065-f956-4a0c-abc0-d78766fa3061 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:21.952831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:21.953495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.953780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.954057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.954777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:21.955088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:21.956480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678603-d43f-42be-85ff-7a7e882dd0c0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:21.971599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 248/495] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:21.971599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:21.971599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:21.971599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:21.986593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:21.987792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:21.996752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15647c8-6579-4d72-88b5-2b73c488afd6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.030721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.031405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.031691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.031971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.032695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:22.033005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.034392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.045582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 248/496] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:22.046294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.051437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 249/497] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:22.052523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.142059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ef203-71c4-4810-bad7-d99dadbea9b1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.145992 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47102c-d20e-4ddc-88c4-29df6b730b31 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.173734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.174384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.174666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.174942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.175712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:22.176017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.177399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fae8e-e092-49a1-b656-9417190b1003 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.177804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.178628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.178912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.179228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.185450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 249/498] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:22.186632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.186739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb805b-36e7-4e8c-acbd-4eb98643189b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.186919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb805b-36e7-4e8c-acbd-4eb98643189b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.187225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb805b-36e7-4e8c-acbd-4eb98643189b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.188109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.188681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 250/499] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:22.189129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb805b-36e7-4e8c-acbd-4eb98643189b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:22.207777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:22.208799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:22.209662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 250/500] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:22.210494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.287607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb805b-36e7-4e8c-acbd-4eb98643189b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.304170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9884c3-2be1-4ab1-87a0-dcb3d815dc28 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.319597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.320383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.320663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.320946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.329058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.330506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.335967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42779736-c749-412e-942f-42227528685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.336782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42779736-c749-412e-942f-42227528685c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.337063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42779736-c749-412e-942f-42227528685c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.337338 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42779736-c749-412e-942f-42227528685c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:22.345645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:22.346537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 29 18:29:22.347444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:22.347948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42779736-c749-412e-942f-42227528685c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:22.348023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 251/501] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:22.348023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-42779736-c749-412e-942f-42227528685c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:22.355348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:22.357120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 251/502] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:22.358093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.358956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.358956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.376265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:22.377452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:22.441158 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 252/503] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:22.441991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.444392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a1799-aa18-43b5-ae36-39fa0a6f5121 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.476285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.477592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.477875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.478152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.488218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.489689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:22.506573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:22.507603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:22.508493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:22.508493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:22.508493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:22.508493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:22.508493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 252/504] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:22.508758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.543363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9ae2-65ea-43f5-9199-25bd13f368f6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.574836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.575465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.575747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.576020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.576853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:22.577158 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.578588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.601196 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a271-ba08-4e75-9e2c-3bdc693cac37 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.614048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 253/505] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:22.614858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.637731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.638395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.638676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.638948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.639817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:22.640126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.641558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.677187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 253/506] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:22.677993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.711133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1eeaec-8402-43d9-bfcb-d19c831e3854 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.743480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.744197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.744483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.744756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.745492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:22.745796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.747185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.754921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 254/507] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:22.755727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.773211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c847ea-2df2-49d3-9b37-5aa7e5cb96e2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.805480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.806262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.806538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.806806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.816360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.817815 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:22.834856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:22.835968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:22.837343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:22.837343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:22.837343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:22.837343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:22.837343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 254/508] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:22.837613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.852979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23c1e-8160-4f91-98ac-dabe5a12748d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.884586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.885493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.885822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.886796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:22.887132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:22.888508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:22.901077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 255/509] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:22.901852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:22.930313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8054-f6d7-4f29-8f4d-99188b4ed967 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:22.961089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:22.962257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:22.962538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:22.962814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:22.993708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9e13-45ad-480c-bca5-4725cef57746 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.023957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.025905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.026167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.026812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.027099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.027404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.089756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.091169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.115121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 255/510] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:23.115944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.182634 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 256/511] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:23.183580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.208028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d53a27-8fa9-4c0c-aece-e3134a0ca496 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.239676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.240453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.240737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.241020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.250489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.251994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:23.269567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:23.270565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:23.271705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:23.271705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:23.271705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:23.271705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:23.271705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 256/512] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:23.272034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.278331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300fd1-dfdb-4235-8414-e7b43e0bc960 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.310399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.311016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.311412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.311807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.312688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:23.313000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.314366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.325684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 257/513] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:23.326461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.368735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d19fc-a2f1-4471-9517-f9e9a6e7501e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.401180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.401959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.402248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.402520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.409231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.410661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.417973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619abb63-cafc-4802-a278-9a9be2005f23 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:23.424651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:23.425519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:23.426417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 257/514] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:23.426996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.456965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.460283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.460283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.460283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.468598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.470068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:23.486542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:23.487500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:23.488916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:23.488916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:23.488916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:23.488916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:23.488916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 258/515] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:23.488916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.526091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498aca-b376-49ad-b224-5f9f785b37e0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.557522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.558306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.558801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.559128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.568642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.570127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.581416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339718-f56b-4827-9a76-610512a50e56 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:23.587457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:23.588288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:23.589175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:23.589175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:23.589175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:23.589175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:23.589175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 258/516] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:23.589439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.612686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.613349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.613640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.613915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.614631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:23.614936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.616384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.628018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 259/517] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:23.628735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.690416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee838-77e3-4778-ab89-41bee575b0f2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.722760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a7cc8-91f6-4bda-b591-c3943e203e48 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.722950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.723529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.723810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.724081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.724775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.726212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.746743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 259/518] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:29:23 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:23.747586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.756810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.757539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.757796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.758055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.758968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:23.759305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.761045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.780591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 260/519] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:23.781761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.853943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa6c6-837f-414e-93be-11efdee97e30 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.885148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fcc8c-ef7c-4fd9-b0ac-e544bdfb00f3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:23.889631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.890452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.890832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.891236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.892065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:23.892466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.893986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.910621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 260/520] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:23.910621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:23.921276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:23.922583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:23.922583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:23.922583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:23.923234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:23.923535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:23.925448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:23.937007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 261/521] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:23.937830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.019386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815bb5-cf80-4a65-ab48-acaeabcf8cc0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.036917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a66e5-804b-4d89-8f4b-ce8b425f2e0c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.052723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.053521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.053797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.054070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.061764 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.063247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.070182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.070943 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.071320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.071673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:24.078498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:24.079630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 18:29:24.080721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:24.086320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 261/522] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:24.086320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.140297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.141845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.179422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53ccc-a186-4db8-a3e7-c36af0b86937 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.211028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.212347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.212629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.212901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.219623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.221102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:24.235719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:24.236548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:24.237431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 262/523] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:24.237925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.243318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 262/524] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:24.244297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.334284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41f7e6-d007-4b72-9686-88d1a414909c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.338835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b888-5828-4b61-b12c-91e681707664 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.366888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.367949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.368385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.368724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.371839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.372503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.372786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.373056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.373885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:24.374277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.375253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.375668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.376714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:24.390720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:24.391597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:24.400639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 263/525] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:24.401100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 263/526] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:24.401188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.401258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.492126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b8ac9-506b-4312-af5e-26944d4bfbb9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.497698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57da31-8889-4538-bd21-d7d31eb2fd60 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.527923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.528585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.528870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.529148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.529941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:24.530252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.531732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.532046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.532846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.533131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.533560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.544306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.546257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.554232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 264/527] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:24.554232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:24.567830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:24.568640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:24.569464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:24.569464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:24.569464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:24.569464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:24.569464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 264/528] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:24.570379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.645686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e321-b618-4170-88ae-38efb1baca7e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.665565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71a010-c83c-4ad9-9a4c-da27e3eb4007 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.679351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.680006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.680840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.681121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.681901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:24.682205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.683677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.699679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 265/529] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:24.699679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.702897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.703576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.703860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.704133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.769281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.770729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.801933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbab28-2c11-4ee1-98f2-13af34838096 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.834623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.835312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.835595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.835869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.837230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=9c539d6a3d1d49bcaadcea8970560c39) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:24.837542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.838982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:24.844542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 266/530] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/role_assignments?user.id=9c539d6a3d1d49bcaadcea8970560c39&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:24.845334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.879580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 265/531] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:24.880558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:24.959751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6c438-d440-40f5-a293-cb6749de30dd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.991541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e15f-e54c-424c-9eba-635397f36451 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:24.995817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:24.996141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:24.996337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:24.996612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:24.997338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:24.997732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:24.999197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.016624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 267/532] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:25.016624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.043909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.044862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.045309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.045744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.046733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=cef8f88990984c38945657983e4111f4) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:25.047278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.048864 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.054873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 266/533] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:24 2022] GET /identity/v3/role_assignments?user.id=cef8f88990984c38945657983e4111f4&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:25.055971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.160349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783f0c3-6b8a-4fb9-9ca0-b355245a82bb None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.200152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2612-8447-4f29-a22b-6d8463d65c88 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.229910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.230659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.230941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.231256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.245009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.246483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.275170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.275981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.276264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.276536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:25.277625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:25.278607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:25.279851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 267/534] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:25.286528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.296295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.297958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:25.325223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:25.326130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:25.327009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:25.327009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:25.327009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:25.327009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:25.329146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 268/535] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:25.334870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.395048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4893b-84b1-45a7-8f27-8464967805e7 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.439660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8922-df0c-4065-af8f-0ca86d338998 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.440109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.440952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.441390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.441828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.442767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:25.443305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.444900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.475325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 268/536] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:25.475802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.476571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.476982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.477357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.478178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:25.478600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.480161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.480695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.492328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 269/537] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:25.504139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.586514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ee5b-2164-42ab-ad3d-4ecd847977be None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.621202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e690-3e55-4eae-aacd-cf24ba22e0b8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.622371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.623036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.623354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.623632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.624469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=0de2845217b943189e11f8a6549b1524) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:25.624782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.626230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.634174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 269/538] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/role_assignments?user.id=0de2845217b943189e11f8a6549b1524&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:25.662087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.662954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.663274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.663550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.671457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.672988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:25.688342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:25.689262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:25.691366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 270/539] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:25.696456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:25.876585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753660b0-1eae-4c72-ab80-cc6f4359dd3e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:25.915666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:25.916362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:25.916647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:25.916930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:25.917757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:25.918069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:25.919605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a9667-769f-444f-bbf1-f80dc707fd21 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:25.933755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 270/540] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:25.939301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:26.088034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941685-6948-4a97-98b4-ee42469ed56e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:26.154691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:26.155316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:26.155597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:26.155878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:26.156709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=840dcc6108454d54ac3fde8bd2096665) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:26.157018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:26.158448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c89b62-54b4-4887-bf1c-7f5fa4d7923d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:26.171519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 271/541] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:25 2022] GET /identity/v3/role_assignments?user.id=840dcc6108454d54ac3fde8bd2096665&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:26.199419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8a59-e20f-468e-ac7d-9d3d350b1fbe None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:26.199736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8a59-e20f-468e-ac7d-9d3d350b1fbe None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:26.199984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8a59-e20f-468e-ac7d-9d3d350b1fbe None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:26.201682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 271/542] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:26.217339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:26.217647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:26.217888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:26.248436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:26.249709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:26.338598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 272/543] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:26.384685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd8a59-e20f-468e-ac7d-9d3d350b1fbe None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:26.516770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd8a59-e20f-468e-ac7d-9d3d350b1fbe None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:26.552201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:26.553424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:26.553958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:26.554433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:26.564973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:26.573205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:26.574067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:26.574859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:26.577481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 272/544] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:26.587142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:26.745405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389f6f8-5bfc-466e-96f5-a597437ef778 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:26.795814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:26.796495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:26.796777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:26.797050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:26.797804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:26.798108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:26.799517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:26.808173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 273/545] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:26.814171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:26.960373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca9c83-c948-41cb-8673-aaff3d6b2c3c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:27.006119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:27.007365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.007854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.008862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:27.026217 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:27.028048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:27.048070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:27.048941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:27.049800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:27.049800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:27.049800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:27.049800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:27.052021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 273/546] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:27.059164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:27.181331 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0c6e2-a94e-430c-86ac-c86d322ab8ee None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:27.217018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:27.217697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.217983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.218261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:27.218995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:27.219339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:27.220724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:27.233266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 274/547] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:27.238408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:27.390821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c70f7-011a-4f95-a07c-d4f6562db026 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:27.441052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:27.442248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.442733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.443272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:27.457831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:27.459678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-8c35d8cb-5e92-4b62-9d8c-f9bd279244a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:27.483916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:27.484884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:27.486197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 274/548] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:27.494142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:27.655472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65db149-034a-42c1-b358-590ab7301646 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.655816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65db149-034a-42c1-b358-590ab7301646 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.656018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65db149-034a-42c1-b358-590ab7301646 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:27.657522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 275/549] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:27.662530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.662825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.663120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:27.666070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d69e-5468-4a44-acb2-fdc858ac4719 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:27.702332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:27.703996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:27.709607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d675-96b1-4271-9867-616875a278bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:27.710786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d675-96b1-4271-9867-616875a278bb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.711368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d675-96b1-4271-9867-616875a278bb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.711846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d675-96b1-4271-9867-616875a278bb None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:27.712713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d675-96b1-4271-9867-616875a278bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:27.713155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d675-96b1-4271-9867-616875a278bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:27.715581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d675-96b1-4271-9867-616875a278bb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:27.754117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 275/550] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Apr 29 18:29:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:27.763083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d675-96b1-4271-9867-616875a278bb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:27.853757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 276/551] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:27.888642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:27.890592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d675-96b1-4271-9867-616875a278bb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:27.928366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd0e8b-9c1c-4f15-8aaf-0df9ea53be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:27.928968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd0e8b-9c1c-4f15-8aaf-0df9ea53be2d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:27.929527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd0e8b-9c1c-4f15-8aaf-0df9ea53be2d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:27.929818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd0e8b-9c1c-4f15-8aaf-0df9ea53be2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.013940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98dd91-ff7b-4606-8190-cd488e5fa42c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.020126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd0e8b-9c1c-4f15-8aaf-0df9ea53be2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.022861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd0e8b-9c1c-4f15-8aaf-0df9ea53be2d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.051834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf517a-56d0-40b2-83aa-a22bd110f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.052642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf517a-56d0-40b2-83aa-a22bd110f518 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.052920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf517a-56d0-40b2-83aa-a22bd110f518 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.053241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf517a-56d0-40b2-83aa-a22bd110f518 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.063996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf517a-56d0-40b2-83aa-a22bd110f518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-faaf517a-56d0-40b2-83aa-a22bd110f518 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:28.072285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:28.073176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:28.074360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 277/552] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:28.075280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0275caf-15d2-46f2-b600-c82a0eacf996 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.075504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0275caf-15d2-46f2-b600-c82a0eacf996 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.075695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0275caf-15d2-46f2-b600-c82a0eacf996 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.081087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 278/553] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:28.081879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0275caf-15d2-46f2-b600-c82a0eacf996 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.134182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 276/554] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:28.136170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.136671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.137142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.153657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:28.155160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:28.188506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0275caf-15d2-46f2-b600-c82a0eacf996 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.222678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 277/555] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:28.224401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.233296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.233981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.234264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.234536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.235313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:28.235615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.236980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.254633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 279/556] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:28.260589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.332890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58809400-f1e6-4a21-ad34-96cd9de90d72 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.361532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa15b-59cf-4917-ac23-f8814f772821 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.372680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.373921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.374415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.374901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.387380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.389312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.402454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.403292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.403574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.403845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:28.409694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:28.410529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:28.411380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:28.411380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:28.411380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:28.411380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:28.417852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:28.418091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 278/557] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:28.419090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:28.422790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:28.423858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:28.425878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 280/558] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:28.429716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.529425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d732-f864-4bc2-bd9d-e7b3155a4002 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.537098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36062-6cd7-4a13-8c1c-ec5681221f3c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.565788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.566453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.566740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.567017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.567766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:28.568069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.569427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.574563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.575374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.575657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.575931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.581019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 281/559] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:28.581807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.590311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.591834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-f2422b02-f4aa-4a83-8583-042b54493117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:28.610602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:28.611537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:28.612350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:28.612350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:28.612350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:28.612350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:28.612350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 279/560] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:28.613098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d1c9-a0eb-469c-8b2d-6fd334f824ca None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.613194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d1c9-a0eb-469c-8b2d-6fd334f824ca None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.613470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d1c9-a0eb-469c-8b2d-6fd334f824ca None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.619148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 280/561] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:28.619923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d1c9-a0eb-469c-8b2d-6fd334f824ca None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.698421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18f5d9-9489-49b9-8d46-28c545061341 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.728901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d1c9-a0eb-469c-8b2d-6fd334f824ca None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.736951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.737633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.737924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.738209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.738966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:28.739309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.740684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.748731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 282/562] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:28.749754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.763535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.764630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.765137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.765558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.772330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.774458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-87182c55-bbeb-42d0-9ecf-9edd20aaf7d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:28.788087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:28.790178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:28.791130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:28.791620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 281/563] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:28.792853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.793143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.793424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.811548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:28.812733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:28.850173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8b4e-9b67-40b4-b889-4a3bdc527ad8 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:28.875550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 282/564] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:28.876573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.890726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:28.891426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:28.891712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:28.891992 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:28.892723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:28.893033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:28.894405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:28.907266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 283/565] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:28.908081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:28.972551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e72f07-88bf-43f8-9b67-5e3cabdb6430 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.004796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d1f7-973f-40c1-855a-da4761bad0bd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.012531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.013334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.013615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.013887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.023727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.025814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.038898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.039615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.039898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.040174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.040963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:29.041276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a36e4d49-eff4-446b-8b48-ed5bd61b58ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:29.042597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.043654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.049181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:29.049181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:29.049181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:29.049181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:29.049422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.049493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 283/566] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.049493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7de6-8521-4479-9f61-af6773b06c57 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.049493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7de6-8521-4479-9f61-af6773b06c57 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.049493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7de6-8521-4479-9f61-af6773b06c57 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.049493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 284/567] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:29.049493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7de6-8521-4479-9f61-af6773b06c57 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.055777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 284/568] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:29.056547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.141671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7de6-8521-4479-9f61-af6773b06c57 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.148174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec0ab-d0e1-464f-8261-64b302226b8b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.172944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.173737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.173998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.174276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.179365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.180170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.180455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.180733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.183826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:29.187911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.189368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:29.191371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.192513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:29.193522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 285/569] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.196124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-d8734fe0-a2fe-484b-a32e-fcc5c372ce4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:29.206686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.207720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:29.208661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 285/570] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.209737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.209737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.210043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.226034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:29.227265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:29.289975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 286/571] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:29.290751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.295062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4db0-9e57-4ace-aa4e-c85a67ddcf8f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.334695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.335387 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.335672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.335947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.336701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:29.337007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.338383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.350200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 286/572] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:29.351004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.393445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9c8e8-cfb7-49f5-b1eb-2e5a9892964b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.424189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.424835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.425117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.425391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.426214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=8e60e2dfa5814b699d107aa74f55c59f) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:29.426520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.427957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.433667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 287/573] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/role_assignments?user.id=8e60e2dfa5814b699d107aa74f55c59f&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:29.434437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.450118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6d4e-1654-4662-9a5f-b4359d4921c9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.486943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.487820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.488199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.488580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.489430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:29.489810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.491376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.505270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 287/574] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:29.505270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.548585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984d85-fcc2-4b0c-841a-6e4c85fd0e71 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.583421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.584116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.584401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.584676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.585542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:29.585852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.587380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.605686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 288/575] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:29.606564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.616045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcab9d-89a9-496a-b4d4-59b100c5bc08 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.652829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.653629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.653905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.654173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.663965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:29.672052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.673156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:29.674186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:29.678092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 288/576] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.679247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.707554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe785ad7-2050-4c87-b28e-d1222fb00984 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.741024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.741836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.742120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.742426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.749987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.751460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:29.766224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.767244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 29 18:29:29.768213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:29.771473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 289/577] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.772438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.777442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189f5a0-c184-4032-aec5-549ca025dd83 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.812097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.812814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.813095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.813369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.823513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.824956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:29.841832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.842785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.848595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:29.848595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:29.848595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:29.848595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:29.848595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 289/578] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.848595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.869514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362179cb-90ea-4e9d-a546-aeb56b598ba2 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.902102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.902899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.903208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.903489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.913135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.915291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:29.934152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:29.935095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:29.936016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:29.936016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:29.936016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:29.936016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:29.939503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 290/579] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:29.940759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:29.947208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d176-22cc-4596-9e4f-4138b8dab7b4 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:29.978633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:29.979313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:29.979597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:29.979873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:29.980612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:29.980916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:29.982269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:29.994574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 290/580] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:29.994574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.040508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9503d7-46d6-4e48-a8c3-7f4ea945cc26 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.074661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.075566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.076062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.076341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.077238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.077606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.079039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.085044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e695-8869-4327-be48-d5471218b35e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.100731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 291/581] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.100731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.117865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.118575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.118860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.119192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.119913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.120221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.121605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.134516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 291/582] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.139150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.200493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e6cf5-a543-4139-a36f-56ead0ff9f19 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.234010 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.234683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.234968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.235281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.236008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.236317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.237680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.238359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592579c0-d007-48e7-bc1d-01acf2abbf73 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.248779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 292/583] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.253947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.271398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.272192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.272474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.272754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.283016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.284500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:30.303092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:30.309061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:30.310159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:30.310159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:30.310159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:30.310159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:30.310159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 292/584] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:30.310159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.355872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20e1e4-dcdb-44cb-90c6-99fe3cd9db5b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.389419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.390246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.390527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.390801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.402479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.403973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.410043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b027ed-19e2-44e3-ab71-8190abb81126 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:30.421625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:30.422655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:30.423755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:30.423755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:30.423755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:30.423755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:30.430116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 293/585] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:30.430116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.444703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.445500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.446538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.446734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.453893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.455543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:30.474217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:30.475218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:29:30.476162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:30.480123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 293/586] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:30.480926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.529419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2260ff-bd88-4a30-9ee4-4c51c0fe133a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.564928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.565837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.566195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.566544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.574010 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.575483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.580631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966c8a3-cba9-48cd-b179-4f897f68428a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:30.589997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:30.591048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:30.592222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:30.595532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 294/587] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:30.596395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.618689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.619319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.619600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.620124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.620582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.620883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.622247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.640378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 294/588] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.640378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.698611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21761a-84d5-4171-981e-77a90f523a2b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.732796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.733471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.733851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.734031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.734761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.735071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.736488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.741490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163fb27-0ada-471a-a078-56b56bcd2927 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.751868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 295/589] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.751868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.779325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.780003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.780291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.780572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.781419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.781735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.783244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.800292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 295/590] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.801185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.847755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529d65-a111-4096-b731-9cd5621dc322 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.880856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.881762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.882242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.882694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.884367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:30.885133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.886735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.898907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 296/591] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:30.899947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:30.901422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321abc2-22ca-4279-a820-c7fade1befcb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:30.937352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:30.938163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:30.938474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:30.938703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:30.946509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:30.947987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:30.962532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:30.963550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 296/592] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:30.964765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.008865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ffdf5-524e-45e8-aa80-c29ed7040972 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.041043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.041839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.042120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.042397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.049729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.051181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.060272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da73117-5e2d-431f-86a9-3d90f48ea825 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:31.064965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:31.065835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 297/593] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:31.072237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.094292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.095079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.095402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.095686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.105393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.106851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:31.124508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:31.125448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:31.126365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:31.126365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:31.126365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:31.126365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:31.130246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 297/594] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:31.131157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.169996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1803a-3e10-4ca1-a02a-249e9231cc46 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.202068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.202947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.203256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.203526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/9c539d6a3d1d49bcaadcea8970560c39/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.217543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=9c539d6a3d1d49bcaadcea8970560c39, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.219015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.228102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84cde5-5a21-433b-81c3-356a9bcd785f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.238015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 298/595] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:31 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/9c539d6a3d1d49bcaadcea8970560c39/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:31.238929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.266658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.267804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.268274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.268744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.269865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:31.270253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.271910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.292439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 298/596] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:31.293535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.367498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbb8e-a966-4b9f-8727-faeb84203aeb None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.404603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f36450-dde1-447a-8e24-345d9be59276 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.405130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.405775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.406161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.406539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.407649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:31.408067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.409651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.428121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 299/597] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:31.429224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.446984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.447782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.448137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.448485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.449286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:31.449663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.451245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.466108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 299/598] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:31.470642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.570050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4cb86-4b59-495b-8d67-a26799595712 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.579038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ad904-9759-4311-bd3c-591c65bc0e24 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.613002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.613896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.614177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.614450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/cef8f88990984c38945657983e4111f4/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.614740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.616012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.616496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.617127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.629227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=cef8f88990984c38945657983e4111f4, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.630734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.631345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.633199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.655225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 300/599] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:31 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/cef8f88990984c38945657983e4111f4/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:31.655225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:31.661913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:31.662895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:31.663817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:31.663817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:31.663817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:31.663817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:31.663817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 300/600] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:31.671023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.803460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e183d9-f30d-455c-b878-bf46c02ec898 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.810984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452595ef-d9a4-4a5d-a234-b209d16fa215 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:31.846331 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.846568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:31.847001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.847123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.847312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.847409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.847593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.847688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.848483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:31.848792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.850161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a7fa1-9f4a-411f-8173-a9e7426fecbc None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.855814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:31.857491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:31.863594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 301/601] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:31.865141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7a956-9f4b-4bd2-8e0e-02c33f219024 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.865469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7a956-9f4b-4bd2-8e0e-02c33f219024 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.865749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7a956-9f4b-4bd2-8e0e-02c33f219024 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.868220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 302/602] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:31.869519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7a956-9f4b-4bd2-8e0e-02c33f219024 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-b235973a-47ce-46b5-b459-662bc898bb6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:31.873429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:31.874377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:31.875335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 301/603] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:31.877642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:31.877927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:31.878202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:31.895344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:31.896532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:31.970572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 302/604] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:31.971430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:31.975861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7a956-9f4b-4bd2-8e0e-02c33f219024 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.010410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.011237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.011522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.011796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.018682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.020162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:32.034617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:32.035726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 303/605] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:32.036710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.099163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a49a-6e0c-4278-9c44-e6c9a9c5d0a1 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.137131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99098a-aca3-4186-ad11-1891174ee4fd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.142175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.142913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.143292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.143635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.144848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:32.145161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.146974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.162136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 303/606] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:32.163141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.178133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.179069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.179478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.179878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.189983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:32.198351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:32.199505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:32.200577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:32.207173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 304/607] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:32.208249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.269834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8f1b-fe3f-41f3-a57b-9a22f0252e06 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.302933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.303621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.303904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.304178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.305482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:32.305791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.307254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.308682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3dac5-596a-4112-9e0b-b5250736ba31 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.319543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 304/608] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:32.321102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.343295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.344316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.344696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.345070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/0de2845217b943189e11f8a6549b1524/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.360007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=0de2845217b943189e11f8a6549b1524, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.361581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.377837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 305/609] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:32 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/0de2845217b943189e11f8a6549b1524/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:32.378894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.431829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c739eeb-b014-4ea0-997b-f770cfc499c5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.476039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.476827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.477155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.477432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.478193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:32.478500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.479925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.489532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 305/610] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:32.496015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.499907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfb435-81ed-4a3e-be4f-2573c4320fe7 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.537183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.538004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.538285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.538559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/840dcc6108454d54ac3fde8bd2096665/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.553957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=840dcc6108454d54ac3fde8bd2096665, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.556036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.575475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 306/611] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:32 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/840dcc6108454d54ac3fde8bd2096665/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:32.604386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7350b6-be55-4cad-ae1c-99dbf4b5b34a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.665144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.666372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.666884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.667437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.685360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.687239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:32.712096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:32.713083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:32.713965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:32.713965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:32.713965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:32.713965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:32.715997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 306/612] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:32.721998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:32.833346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b69702-16b9-4e89-96b6-b7a0a22fc15d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:32.866904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:32.868190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:32.869203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:32.869478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:32.870214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:32.870516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:32.871908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:32.884223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 307/613] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:32.890194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.008251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319fe50-72d0-4e43-9133-ad6f7e56b2bd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:33.049073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:33.049871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.050150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.050422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.058775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:33.060276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:33.083157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:33.084217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:33.085163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 307/614] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:33.091139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.204680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d61040-ecb7-4885-b8aa-31ccd22819ab None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:33.238018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:33.238688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.238968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.239274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.240113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:33.240418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:33.241836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:33.259782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 308/615] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Apr 29 18:29:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:33.265576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.365283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a799df-1ab7-4690-a68f-b1eed17ac63c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:33.399840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:33.400630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.400910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.401185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.411663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:33.413114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:33.430376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:33.432843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:33.434953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:33.434953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:33.434953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:33.434953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:33.434953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 308/616] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:33.443126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.539559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203913c-17ef-40c0-aee7-40c216293c64 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:33.577143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:33.577875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.578156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.578427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.579233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:33.579538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:33.580904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:33.596709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 309/617] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:33.602406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.721359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbf2e-cbe5-45aa-8626-29b73d6eb1f7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:33.753948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:33.754744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.755025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.755328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.763157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:33.764683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-dcb07100-3f98-4af3-a0ec-3ce7988cc162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:33.780447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:33.781386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:33.783260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 309/618] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:33.787631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.804224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36d25-7e67-4652-b899-e74c1a9866e7 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.804565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36d25-7e67-4652-b899-e74c1a9866e7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.805380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36d25-7e67-4652-b899-e74c1a9866e7 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.807000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 310/619] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:33.812874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:33.813243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:33.813587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:33.832314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:33.833716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:33.907080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 311/620] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:33.942547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:33.987948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd598-d0c0-4e56-b1ef-84fed3b8d28f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:34.057535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:34.058330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.058665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.058945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.059770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:34.060079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:34.062294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:34.082489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 310/621] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:34.084653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:34.120452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839896-1188-47de-a69f-24a77ab979bf None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:34.191820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:34.192639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.192927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.193207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.209831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:34.221018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:34.221974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:34.222801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:34.229971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 312/622] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:34.236718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:34.275833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a034-9372-4b42-bc4e-4772d016dd5a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:34.363957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:34.364830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.365117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.365396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/8e60e2dfa5814b699d107aa74f55c59f/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.373990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca26b-9e42-4bfe-a775-0ad078e33e0e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:34.409676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:34.410752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.411294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.411768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.412010 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=8e60e2dfa5814b699d107aa74f55c59f, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:34.412982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:34.413488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:34.413689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:34.415807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:34.425213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 313/623] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:34.435807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:34.441997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 311/624] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:34 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/8e60e2dfa5814b699d107aa74f55c59f/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:29:34.587131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2f746-8035-475c-bb3e-9b173a14af49 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:34.633341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:34.634166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.634451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.634727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.653588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:34.655090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-7cd50cae-8d43-4394-a8f9-89c8e260971e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:34.680758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:34.681695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:34.683010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:34.683010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:34.683010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:34.683010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:34.683010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 314/625] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:34.688119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:34.772359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf902e2-50a0-449c-92ad-6a59573a9523 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.772689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf902e2-50a0-449c-92ad-6a59573a9523 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.772926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf902e2-50a0-449c-92ad-6a59573a9523 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.774986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 315/626] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:34.783236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.783236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.783236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.813377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:34.814578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:34.833752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a7bc-9e80-43f3-8d38-e8409aba4683 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:34.884401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:34.885428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:34.885624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:34.885908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:34.886680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:34.886997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:34.888396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:34.913544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 316/628] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:34.915480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 312/628] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:34.916634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:34.978844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.040270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0c350-ccf4-43dc-8b62-02fc35981fcc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.074403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.075578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.076083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.076571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.084100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.085832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:35.101444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:35.102425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:35.103368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:35.105584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 317/629] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:29:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:35.110627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.155919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98561d6-6f44-480a-9750-a4d2f8c96035 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.191785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015ac16-8300-4c2e-b339-cabee068da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.192184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015ac16-8300-4c2e-b339-cabee068da4b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.192469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015ac16-8300-4c2e-b339-cabee068da4b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.192745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015ac16-8300-4c2e-b339-cabee068da4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.203869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015ac16-8300-4c2e-b339-cabee068da4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-f015ac16-8300-4c2e-b339-cabee068da4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:35.212059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:35.213176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 313/630] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:35.217841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e391e4-cf7f-40c9-9ddf-8586e5aa510b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.219968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e391e4-cf7f-40c9-9ddf-8586e5aa510b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.219968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e391e4-cf7f-40c9-9ddf-8586e5aa510b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.220941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 314/631] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:35.222061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.222353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.222637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.236639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694061-ad37-4a13-bd8b-d0669153e3b9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.239739 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:35.240791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:35.271339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.272417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.272929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.273442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.274945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:35.275416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.276989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.294847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 318/632] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:35.296043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.307820 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 315/633] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:35.308675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.397252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e12e90-18a0-4a86-b1f9-905fc857594f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.424811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a48b5a-56e9-48d1-a8c1-46c58d23d3a8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.430632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.431328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.431611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.431883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.432626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:35.432930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.434301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0d0be-d097-47ff-92b9-3bb7e9d96639 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.443039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 319/634] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:35.444348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0d636-1b68-4935-ac4a-3705b9fc0020 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.444639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0d636-1b68-4935-ac4a-3705b9fc0020 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.444920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0d636-1b68-4935-ac4a-3705b9fc0020 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.450602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 320/635] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:35.450602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0d636-1b68-4935-ac4a-3705b9fc0020 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.473363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d1cc3-9234-4fac-9dc2-c7752ef9ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.474024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1cc3-9234-4fac-9dc2-c7752ef9ee86 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.474306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1cc3-9234-4fac-9dc2-c7752ef9ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.474582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1cc3-9234-4fac-9dc2-c7752ef9ee86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.540749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d1cc3-9234-4fac-9dc2-c7752ef9ee86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.542224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d1cc3-9234-4fac-9dc2-c7752ef9ee86 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.548870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0d636-1b68-4935-ac4a-3705b9fc0020 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.581506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.582297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.582577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.582850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.593008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:35.600629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:35.601577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:35.602440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 321/636] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:35.604003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.651300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 316/637] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:35.651300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.651300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.651300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.664627 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:35.665835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:35.703501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2542c-019c-4c86-a8dd-63847c2d5dc7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.730080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 317/638] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:35.730925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.748507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.749426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.749717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.750298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.761999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.763755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:35.782035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:35.782960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:35.783875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:35.783875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:35.783875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:35.783875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:35.783875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 322/639] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:35.784634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.830680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa574577-c085-401b-b1be-8e47195d98e5 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.867166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.868405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.868682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.868953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.869690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:35.869996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.871380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.879031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 318/640] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:35.879834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.891368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad31a-4108-4165-9a03-5640e36a8b50 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:35.925153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:35.925948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:35.926238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:35.926573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:35.937506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:35.938968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:35.956089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:35.956978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:35.957880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:35.957880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:35.957880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:35.957880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:35.960323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 323/641] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:35.961070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:35.975091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e090ea-d7aa-4486-9d6a-0a322904f879 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.009242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.010286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.010570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.010842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.020687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:36.028687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:36.029723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 319/642] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:36.035725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.061645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7aaf9-3848-432f-a5f0-ef7fbe5107b9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.093492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.094156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.094443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.094723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.095490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.095805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.097187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.109786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 324/643] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.109956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.126479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa446b0-1781-4c9f-91a3-28c1b2cbd14a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.160220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.161022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.161302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.161572 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.172290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.173724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:36.190239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:36.196936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:36.198080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:36.198080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:36.198080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:36.198080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:36.198080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 320/644] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:36.198080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.205942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8449-2459-4bc5-a4e3-6cbfe145a20d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.240457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.241106 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.241391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.241670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.242392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.242724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.244129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.255836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 325/645] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.256612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.300317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902402-e8b0-44d5-add4-7bda1f38c4a3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.333388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.334043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.334337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.334612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.335408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.335713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.337586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.345306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 321/646] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.346091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.361062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1991c94-610c-4d8c-8265-a86754b17f56 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.402449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.404155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.404631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.405240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.415889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.417573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:36.436269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:36.437258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 29 18:29:36.438211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:36.444828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 326/647] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:36.444828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.450802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb67a7-188f-41ba-90e9-f596c3ab45e5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.483679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.484351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.484638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.484915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.485639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.485946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.487344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.498730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 322/648] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.499487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.548364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee27f-3d22-488a-9071-9df17972d807 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.580678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.581471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.581825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.582108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.589157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.590623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.594772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad21ae7-458a-4e0e-aa85-f77fa1f89ee1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:36.605361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:36.606361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 327/649] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:36.607689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.634349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.635445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.635727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.636000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.645865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.647329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:36.665619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:36.666561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:36.667495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:36.667495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:36.667495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:36.667495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:36.671224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 323/650] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:36.671973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.709957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fcd8a-0dae-4926-ad4f-a4bc48b1cc28 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.742810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.743510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.743797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.744074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.744908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.745217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.746656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.768688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 328/651] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.768688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.776529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6ff45-41cf-4e06-96c2-82e7f49f1e6e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.813430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.814248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.814538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.814819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.823404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.825052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:36.839762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:36.840726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:36.841653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 324/652] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:36.842853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.869020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da2a7-fae1-4fd2-97c6-bcabff703333 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.902388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.903046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.903358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.903633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.904414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.904745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.906144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.917484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 329/653] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.922638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:36.942301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb5c4-a2d9-40ac-813e-4a8b3f3d430b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:36.976129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:36.976797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:36.977080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:36.977358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:36.978082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:36.978389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:36.979789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:36.990647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 325/654] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:36.991468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.018303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b4e6a-3cdf-48e5-a2f6-feeeddf16f5b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.049249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a49dd1-a3d8-4b52-b2e6-4300e122994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.049838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49dd1-a3d8-4b52-b2e6-4300e122994d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.050131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49dd1-a3d8-4b52-b2e6-4300e122994d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.050407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49dd1-a3d8-4b52-b2e6-4300e122994d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.084740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ad54-a45f-4399-9396-d18eb1466cad None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.112910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49dd1-a3d8-4b52-b2e6-4300e122994d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.114382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49dd1-a3d8-4b52-b2e6-4300e122994d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.115555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.116223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.116509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.116788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.118148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:37.118459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.119892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.136965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 326/655] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:37.137755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.207096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 330/656] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:37.208553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004010a-2521-4bd4-82f6-2d7b4e9bb6cc None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.208841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004010a-2521-4bd4-82f6-2d7b4e9bb6cc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.209117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004010a-2521-4bd4-82f6-2d7b4e9bb6cc None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.211158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 331/657] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:37.211399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004010a-2521-4bd4-82f6-2d7b4e9bb6cc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.234007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8934e6b-41f8-4f60-ad8c-9e1ea3b92ac3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.270842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.271539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.271826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.272106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.272955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=9c539d6a3d1d49bcaadcea8970560c39) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:37.273269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.274699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.280380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 327/658] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/role_assignments?user.id=9c539d6a3d1d49bcaadcea8970560c39&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:37.281155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.310608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004010a-2521-4bd4-82f6-2d7b4e9bb6cc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.347318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.348149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.348435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.348716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.357026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.358535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:37.374677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:37.375790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 332/659] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:37.376826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.406047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7778f-cbdd-46e4-9cd1-0c211925141f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.442480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.443156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.443453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.443741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.486512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f8925-f31a-40d9-b333-3d5a5acb0aa7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.520053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.521904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.525312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.525474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.525653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.525937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.538044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.540102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-358ed0a3-48cd-40ed-b12f-d4c47216a5db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:37.558784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:37.559829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:37.560973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:37.560973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:37.560973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:37.560973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:37.560973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 333/660] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:37.561325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.561565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.561846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.577635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:37.578829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:37.629184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 328/661] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:37.629184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.651271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 334/662] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:37.651271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.728936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f02c6-4995-435c-8201-d771f5c03c3b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.750845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe608d-943f-4c45-9c73-860c0c23f7a7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.761456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.762133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.762418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.762694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.763568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:37.763880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.765315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.782867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 329/663] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:37.783782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.789897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.790557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.790842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.791142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.791872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:37.792407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.793553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.809170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 335/664] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:37.809170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.879695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a2f2f-aebc-43fb-bb23-c2b13a451535 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.907076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4155d5c-2ff7-4cc1-beee-30ce1edbdb7c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:37.912529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.913334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.913624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.913894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.925590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:37.927044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:37.940170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:37.940983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:37.941265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:37.941538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:37.944588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:37.946029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:37.951800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:37.951800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:37.951800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:37.951800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:37.951800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 330/665] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:37.951800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:37.957668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:37.965943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:37.972935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 336/666] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:37.975059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.050160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c72fe-f935-433b-bc1d-511695d8949e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.071621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afeb19-117f-4a1d-8a5c-74e3ec169350 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.084088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.084750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.085034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.085316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.104132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.105174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.105474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.105736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.112597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.114064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:38.128199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:38.129095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:38.130159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:38.131967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 337/667] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:38.133370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.162388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.163865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.236815 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88b7ce-7876-420f-923b-c8f58015bb6b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.258587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 331/668] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:38.259782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.276674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.277351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.277800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.278082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.278809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:38.279135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.280560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.291714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 338/669] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:38.292660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.357804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5130dd8-695a-4fe9-baa6-d96723fad1ec None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.390124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c7dde-74f9-4d84-b6b3-585ece591487 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.391237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.391913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.392194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.392467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.393203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:38.393507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.394867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.402724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 332/670] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:38.403550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.427989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.428754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.429103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.429447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.430816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:38.431253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.432713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.449973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 339/671] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:38.449973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.511952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200583d1-4c0e-4d88-9836-636b59e5fda1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.543321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.544127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.544410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.544687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.547576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7063-afe5-4e46-b4c9-ce7a0c3ccfdb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.555554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.557003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:38.574211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:38.575213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:38.576687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:38.576687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:38.576687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:38.576687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:38.576687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 333/672] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:38.576687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.585332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.586155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.586437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.586735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.593270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.594714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:38.608336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:38.609228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:38.610112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 340/673] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:38.611365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.679746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56f0e-6afe-4aea-acff-389601be3d53 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.711986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.712565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8864670-8463-4cfe-bdec-48aabd4f927a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.712805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.713082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.713360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.723625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.725083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:38.743542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:38.744607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:38.745697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:38.745697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:38.745697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:38.745697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:38.751017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 334/674] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:38.751017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.751736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.752462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.752813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.753155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.754059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=cef8f88990984c38945657983e4111f4) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:38.754465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.756010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.771367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 341/675] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/role_assignments?user.id=cef8f88990984c38945657983e4111f4&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:38.771367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.878643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb4ab-adac-4030-8c94-365d7b7a9642 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.883493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf4ed0-ff46-46ff-99f5-6ca7d6307e23 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:38.915183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.916037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.916324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.916678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.917606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:38.917948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.920064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.920859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:38.921692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:38.922077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:38.922452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:38.923414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:38.923828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:38.925394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:38.934685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 335/676] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:38.935657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:38.944415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 342/677] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:38.945608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.036495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53260ccb-93b4-4a2b-a1d5-08d905b72ac9 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.055894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfb3c4-3755-4a17-bc7c-dfc1b69ffe90 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.071558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.072234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.072514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.072791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.073515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:39.073819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.075212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.087500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 336/678] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:39.088405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.093961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.094765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.095046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.095351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.103028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.104528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:39.118979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:39.121075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 343/679] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:39.123078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.188102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c729-8c46-419b-9dd7-4506b5771283 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.220846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f82478-6a0e-44e0-9c52-6d2e5d28a7a3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.222254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.222918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.223242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.223518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.224355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=0de2845217b943189e11f8a6549b1524) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:39.224665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.226089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.233034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 337/680] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/role_assignments?user.id=0de2845217b943189e11f8a6549b1524&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:39.233919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.283049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.283949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.284232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.284507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.303929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.306105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:39.323585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:39.325567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:39.326717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 344/681] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:39.337428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.447552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3598-c408-4c69-9192-ce7db0f6828b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.493894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.494748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.495211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.495589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.496566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:39.496979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.498601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.517351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 338/682] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:39.520289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a931-a7f5-4129-adf8-22b5798c606e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.524681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.562824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.563686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.564070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.564445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.565388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:39.565795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.567379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.591305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 345/683] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:39.597143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.633376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88532a8-07db-4d2e-8605-18945e32bb15 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.670319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be13914-0464-4368-a971-25136093223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.670980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be13914-0464-4368-a971-25136093223e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.671310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be13914-0464-4368-a971-25136093223e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.671593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be13914-0464-4368-a971-25136093223e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.672430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be13914-0464-4368-a971-25136093223e None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=840dcc6108454d54ac3fde8bd2096665) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:39.672744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be13914-0464-4368-a971-25136093223e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.674173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be13914-0464-4368-a971-25136093223e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.682265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 339/684] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/role_assignments?user.id=840dcc6108454d54ac3fde8bd2096665&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:39.686124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba0aa-a126-40e9-928b-171d5a849a47 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.686420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba0aa-a126-40e9-928b-171d5a849a47 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.686701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba0aa-a126-40e9-928b-171d5a849a47 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.688413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 340/685] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:39.694099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.694386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.694673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.712602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:39.713757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:39.717660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ddbd4-a89d-4566-9f0d-985ac1cd9778 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:39.756666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:39.757521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:39.758350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:39.758625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:39.832829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:39.834323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:39.850894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 341/686] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:39.891387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.942969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 346/687] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:39.949670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:39.991615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98c24-148b-47f6-9401-45626a413d96 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.027500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.028293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.028580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.028861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.039314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:40.047051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6348e-bf93-4eda-ac7c-dced9fcd5a36 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:40.047934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:40.049967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:40.051958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 342/688] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:40.056155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.086931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.087776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.088056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.088336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.101174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.102748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:40.129844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:40.131968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:40.134655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:40.134655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:40.134655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:40.134655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:40.139553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 347/689] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:40.144837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.156289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee557a-155c-4d3a-a69a-6ea9476b15df None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.190683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.191393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.191688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.191968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.192727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:40.193030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.194412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.207284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 343/690] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:40.208561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.299168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988810-115b-4fe3-ad68-6bbce61c5e8c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.336145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.337252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.337536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.337809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.338530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:40.338834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.340236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.349562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa8ee5-6c3b-4452-a3f2-d306ad6a9d87 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.366530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 348/691] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:40.371675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.402988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.404569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.405082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.405569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.418424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.420427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:40.440300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:40.441228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:40.442144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:40.442144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:40.442144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:40.442144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:40.445062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 344/692] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:40.453290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.546718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f53e8-b88b-4071-aff8-e4af8369bb5b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.588767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.589512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.589759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.590036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.597054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.598515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.606629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0284c-acf0-4c92-a542-e01b8069bfa9 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:40.614101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:40.614979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:40.615898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 349/693] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:40.621123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.640575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.641252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.641539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.641818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.642556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:40.642872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.644285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.657046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 345/694] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:40.662325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.721158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d7dbd-b076-4d1d-a40f-0e8e3ba26b3c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.757579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.758341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.758620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.758944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.759770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:40.760325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.761769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.774388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 350/695] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:40.780203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.786478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6289-56ee-418e-9776-5ad44cd6c33c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:40.849968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:40.850784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:40.851072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:40.851367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:40.868261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:40.869733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:40.890685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:40.891686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:40.893060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 346/696] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:40.903836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:40.964294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b56c1-3a17-498e-84fb-b4e4e82753fe None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:41.030227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:41.030892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.031205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.031488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.032326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=8e60e2dfa5814b699d107aa74f55c59f) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:41.032638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:41.034074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:41.040374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 351/697] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/role_assignments?user.id=8e60e2dfa5814b699d107aa74f55c59f&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:41.104647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40fb87-4a35-46d5-a736-eedf73ed5a6a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:41.159608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:41.160320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.160599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.160874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.161755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:41.162066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:41.163623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:41.190669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 347/698] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:29:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:41.196575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:41.341475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2218ea-f0a6-4ba5-9a57-3e845137d471 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:41.375678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b12b-edab-4188-ad8d-69f69d232cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:41.376256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b12b-edab-4188-ad8d-69f69d232cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.376543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b12b-edab-4188-ad8d-69f69d232cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.376823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b12b-edab-4188-ad8d-69f69d232cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.448989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3b12b-edab-4188-ad8d-69f69d232cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:41.450463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3b12b-edab-4188-ad8d-69f69d232cf5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:41.554333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 352/699] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:41.560344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:41.661850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a86abf-98b0-4036-a77b-d460bce4029e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:41.671355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72febb-62f5-4032-9aea-ce531f933dfe None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.671810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72febb-62f5-4032-9aea-ce531f933dfe None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.672039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72febb-62f5-4032-9aea-ce531f933dfe None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.673343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 353/700] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:41.680590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.681449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.682216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.705390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:41.705581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:41.706249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.706537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.706816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.707786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:41.719045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:41.720957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:41.743947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:41.744881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:41.745769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:41.745769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:41.745769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:41.745769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:41.745996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 348/701] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:41.752235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:41.804803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 354/702] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 18:29:41.834814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:41.902347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ee27-9fec-43f6-9487-07e377084349 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:41.951220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:41.951220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:41.951220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:41.951220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:41.951608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:41.951608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:41.951608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:41.964233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 349/703] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:41.970057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:41.979271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d07df-9288-4027-b7c0-f570152fbc8a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.040905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.042232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.043502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.044004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.057219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.059529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.074218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7393801-dc55-4633-895b-a293ac65521b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3ac97620-79b8-4361-98ad-d0160d9549ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:42.082572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:42.083516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:42.084392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:42.084392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:42.084392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:42.084392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:42.086998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 355/704] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:42.092612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3681-cf58-4b3c-ae4f-6c492a868714 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.092902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3681-cf58-4b3c-ae4f-6c492a868714 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.093416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3681-cf58-4b3c-ae4f-6c492a868714 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.094839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 356/705] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:42.095462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a3681-cf58-4b3c-ae4f-6c492a868714 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.122297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.123908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.124669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.125152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.135627 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.137543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-c31ee700-57b7-4c72-85fe-eb1d8c50f29a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:42.157170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:42.158144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:42.159076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:42.165733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 350/706] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:42.165733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.165733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.165733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.189453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:42.192287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:42.222439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a3681-cf58-4b3c-ae4f-6c492a868714 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.264549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 351/707] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:42.265837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.279281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.280311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.280817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.281294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.282233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:42.282736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.286217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.308635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 357/708] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:42.308635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.405477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4b57-ade2-446a-855a-7fbc0e97fc48 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.410422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461947c-205b-4c27-83f6-dd9a1712dc94 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.447767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.448588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.448866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.449136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.449791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.450823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.451178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.451561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.451808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.452084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.452879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:42.453183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.454616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116582d-9e91-487b-ad40-e0f1b02328ae None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:42.465531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:42.466706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:42.468083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 358/709] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:42.469015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.479418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 352/710] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:42.479418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fdc9-94d7-4acc-960e-323bdfcee94c None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.479418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fdc9-94d7-4acc-960e-323bdfcee94c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.479418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fdc9-94d7-4acc-960e-323bdfcee94c None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.479418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 353/711] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:42.479418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fdc9-94d7-4acc-960e-323bdfcee94c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.575562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c354116-c001-474a-b828-cd52d1c6665f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.578831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fdc9-94d7-4acc-960e-323bdfcee94c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.609784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.610452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.610733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.611008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.611972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.612624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.613299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.613394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.613583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.613858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.614569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:42.614879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.616268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072a9db-df4e-490d-9253-bc4ea4994565 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.621342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 354/712] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:42.622349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.622642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.622922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.638198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 359/713] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:29:42 2022] POST /identity/v3/users => generated 254 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:42.639348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.644431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:42.645678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:42.724866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 355/714] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:42.724866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.783858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ffb82-c0e9-447a-9436-00b9e575eb50 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.820516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.821195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.821482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.822021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.822610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=9c539d6a3d1d49bcaadcea8970560c39) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:42.822928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.824460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.830758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 360/715] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/role_assignments?user.id=9c539d6a3d1d49bcaadcea8970560c39&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:42.831647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:42.847621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523da1-a796-41e9-8463-964b60c7dfb4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:42.888130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:42.888812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:42.889096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:42.889370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:42.890153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:42.890459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:42.891985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:42.899144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 356/716] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:42.956071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17c98b-e84d-442a-a803-bf9a115f4f22 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:43.001563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:43.002396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:43.002676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:43.002951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:43.003662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:43.005127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:43.019956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:43.021005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:43.021829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 361/717] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:42 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:43.028285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:43.143619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc66d1-9d01-435d-8c79-88dcd2f13d07 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:43.182284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:43.182953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:43.183264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:43.183549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:43.184251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:43.184554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:43.185913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769d63-c4b4-4763-b5f8-809646799bd9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:43.190290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 357/718] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:29:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:43.196286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:43.295406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0faf-94e7-4c15-8a9c-c203932dd6d3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:43.328960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:43.329628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:43.329910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:43.330188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:43.330892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] RBAC: Adding query filter params (type=network) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:43.331230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:43.332607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd64c3a-cc09-42aa-92f2-13bcdef3a250 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:43.339250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 362/719] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:29:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:44.224035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbe4d-837f-474e-926a-bd46140599d9 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:44.224825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbe4d-837f-474e-926a-bd46140599d9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:44.224825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbe4d-837f-474e-926a-bd46140599d9 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:44.226891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 358/720] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:44.232281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:44.232896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:44.232896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:44.250245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:44.251460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:44.321190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 363/721] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:44.344269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbe4d-837f-474e-926a-bd46140599d9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:44.574642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbe4d-837f-474e-926a-bd46140599d9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:44.608651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:44.609450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:44.609739 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:44.610000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:44.620038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:44.627477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:44.628398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:44.629614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 359/722] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:44.634681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:44.732582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936c23-53e5-48d6-8c0b-80a6cc0991f2 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:44.780947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:44.781640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:44.781931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:44.782214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:44.782970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:44.783308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:44.784702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:44.799377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 364/723] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:44.805040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:44.916638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9eb21-53e0-45ff-9d8f-91e0b12608af None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:44.952207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:44.953015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:44.953293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:44.953565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:44.965022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:44.966489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:44.984144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:44.986430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:44.988789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:44.988789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:44.988789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:44.988789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:44.988789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 360/724] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:44.995152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:45.099858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f7da6-bd24-42f2-b9d1-d46b5337026a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:45.134852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:45.135793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:45.136207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:45.136484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:45.137203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:45.137506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:45.138894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:45.151649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 365/725] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:45.157282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:45.267081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ca031-4757-441c-98e7-0ac00428c9da None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:45.301586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:45.302390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:45.302668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:45.302977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:45.311926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:45.313444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:45.328356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:45.330772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:45.333160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 361/726] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:45.339723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:45.443807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8b306-8b9e-443f-86f8-9c30760d003f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:45.478766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:45.479476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:45.479758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:45.480031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:45.480872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:45.481178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:45.482745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd952b3-02e5-45ca-9dcb-ad9b71317d6b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:45.509320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 366/727] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Apr 29 18:29:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:45.515215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:45.624281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a6921-2ec0-4f8b-b45d-a0a56d206e62 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:45.657514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:45.658173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:45.658454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:45.658728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:45.725315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:45.727335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:45.767913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be149b4-94b4-4931-8de8-6b388288bb48 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:45.768556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be149b4-94b4-4931-8de8-6b388288bb48 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:45.769420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be149b4-94b4-4931-8de8-6b388288bb48 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:45.771863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 367/728] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:45.776767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:45.777320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:45.777793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:45.799597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:45.801359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:45.876178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 362/729] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 18:29:45.883862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:45.887817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 368/730] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:45.934361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:45.991267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b25d62-c1d1-4fc7-b7ad-8494014d813f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.026794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.027003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.027324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.027586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.038103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.039710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.056997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f357f6-b9a5-442a-ad64-8ca01954b801 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-891a59ab-0e13-4629-99f5-ac7dc135db51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:46.057949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:46.058813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:46.059790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:46.059790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:46.059790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:46.059790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:46.059790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 363/731] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:46.066006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00a10-d940-4379-8d33-77946ba69c68 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.066006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00a10-d940-4379-8d33-77946ba69c68 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.066006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00a10-d940-4379-8d33-77946ba69c68 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.066006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 364/732] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:46.067207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00a10-d940-4379-8d33-77946ba69c68 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.100080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60041819-c3b6-4531-8b1e-213482e4b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.101307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60041819-c3b6-4531-8b1e-213482e4b4fa None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.101820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60041819-c3b6-4531-8b1e-213482e4b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.102294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60041819-c3b6-4531-8b1e-213482e4b4fa None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.103280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60041819-c3b6-4531-8b1e-213482e4b4fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.104917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60041819-c3b6-4531-8b1e-213482e4b4fa None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.121296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 369/733] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:29:45 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:46.122953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e3c4f-9c2a-4967-90ca-9b2e4736b255 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.123572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e3c4f-9c2a-4967-90ca-9b2e4736b255 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.123966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e3c4f-9c2a-4967-90ca-9b2e4736b255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.142653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-260e3c4f-9c2a-4967-90ca-9b2e4736b255 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:46.143962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-260e3c4f-9c2a-4967-90ca-9b2e4736b255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:46.204220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00a10-d940-4379-8d33-77946ba69c68 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.239137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 370/734] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:46.239137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88434e-9e19-48a8-b823-800961ce9e70 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.239137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88434e-9e19-48a8-b823-800961ce9e70 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.239137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88434e-9e19-48a8-b823-800961ce9e70 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.243581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 371/735] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:46.245350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.245649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.245935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.272137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:46.272751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.273407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:46.274255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.274786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.275293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.277467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:46.278036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.279784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.297296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 365/736] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:46.298801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.352361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 372/737] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:46.353952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.413304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cf71c-5901-4bb7-81cf-5b5cd4a4a9dd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.446860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.448041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.448548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.449036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.459993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711c608-8c80-41aa-a84a-ecfa4e113b68 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.464380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:46.472289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:46.473303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 366/738] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:46.479774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.494672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.495472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.495754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.496032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.502836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.504325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-8664ebc6-e334-44ef-823a-d5779cd084bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:46.520051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:46.521039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:46.521996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 373/739] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:46.522921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b308-fea5-423f-acd6-0f3cef79132d None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.522921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b308-fea5-423f-acd6-0f3cef79132d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.523094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b308-fea5-423f-acd6-0f3cef79132d None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.528389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 374/740] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:46.528389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b308-fea5-423f-acd6-0f3cef79132d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.589289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bfce-30ee-4e95-8e13-cd35540e2621 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.621921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.622849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.623157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.623444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.633584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:46.634187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b308-fea5-423f-acd6-0f3cef79132d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:46.641360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:46.642318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:46.643175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:46.647580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 367/741] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:46.648116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.668562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.669165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.669453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.669735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.670483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:46.670793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.672213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203daa-697c-42a3-9bb9-2d6ab37ac161 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.680220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 375/742] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:46.681397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.681689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.681964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.751362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bcbe3-6b32-49ba-8e77-299ff17c0821 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.785456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.786131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.786410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.786679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.787513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:46.787824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.789890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.802667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 368/743] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:46.804409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.818505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:46.819714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:46.896828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 376/744] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 18:29:46.896828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:46.908482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505824-2b81-452e-bab9-a6866fb7c8ac None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:46.946175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:46.946768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:46.947053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:46.947363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:46.948114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:46.948419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:46.949790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:46.957766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 369/745] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:46.958565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.003557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5828-f20c-462e-85f1-f35eb884ccc4 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.039239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.040185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.040719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.041025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.052368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.053820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.054609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dad2a-5256-49ea-837f-494bee7b2ef5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:47.071644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:47.072560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:47.073435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:47.073435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:47.073435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:47.073435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:47.075531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 377/746] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:47.076631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.088627 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.089556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.089995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.090410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.091432 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=8e60e2dfa5814b699d107aa74f55c59f) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:47.091883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.093459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.107342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 370/747] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:46 2022] GET /identity/v3/role_assignments?user.id=8e60e2dfa5814b699d107aa74f55c59f&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:47.108318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.199429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5527b-0578-446a-9f0c-3c3569448e07 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.223693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8793268-ea80-43bf-a758-d1c996efa96d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.242452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.243228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.243519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.243800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.244544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.245985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.271397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 378/748] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:29:47 2022] POST /identity/v3/services => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:47.271397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.291507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.292385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.292668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.292941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.305491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.307022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:47.326415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:47.327461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:47.328786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:47.328786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:47.328786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:47.328786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:47.328786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 371/749] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:47.334114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.395823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499596-4144-4055-adcb-71c395137cc1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.444617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.444974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3a9-fd9f-4e0e-92c8-169f81fe8ac9 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.445902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.447141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.447141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.447508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:47.447508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.448891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.479607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 379/750] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:47.481244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.481969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.482254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.482529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.483308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:47.483937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.484782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.485393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.499928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 372/751] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:47.505504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.592834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3d159-0d35-43f6-ba6a-7614247f2f3c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.608486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef444b-1d72-461a-ad9f-f835e17a0105 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.628809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.629619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.629897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.630166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.638466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.639943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.644043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.644844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.645127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.645400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.653059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.654501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:47.654955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:47.656035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:47.657631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 380/752] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:47.661647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:47.669959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:47.672187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:47.674521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 373/753] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:47.679327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.771753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6d48-4788-44fd-9a79-04027d53b421 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.790481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c40f8-ef09-4c0c-bf04-8181317e6d55 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:47.834929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.836040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.836541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.837015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.838208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:47.839768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.842051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.852793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:47.853801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:47.854286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:47.854777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:47.855868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:47.856525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:47.859512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:47.875640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 381/754] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:47.880789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:47.900697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 374/755] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:47.911157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.044305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf520d-33cc-485e-a6ee-0bdbdfc2a8f0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.084758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89023f-ee6b-42c4-bce6-fb39ebb4a231 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.110797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.111815 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.113049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.113530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.152554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.153771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.154261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.154737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.170582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.172344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:48.204924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:48.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:48.207393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:48.207393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:48.207393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:48.207393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:48.207393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 375/756] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:48.211981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.231578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.233311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.331078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 382/757] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:29:48.341375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.426178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c8519-d33a-44dd-94dc-0451b5680689 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.452891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815105c-3f9f-4be2-9177-58170bce36a9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.495818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.496634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.496918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.497192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.515869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.516553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.516837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.517112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.517847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:48.518154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.519560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.521760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.523771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.543610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 376/758] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:48.548811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:48.558200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:48.559146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:48.560057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:48.560057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:48.560057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:48.560057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:48.560057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 383/759] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:48.568448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.690345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667df9-d353-4bf0-8215-1a265b4b909f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.696157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265a7b8-64cb-4cd3-a9b7-7d87e94b7e2d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.728691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.729734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.730233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.730714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.731681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:48.732184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.732429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.733236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.733521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.733799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.734615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c0502-208a-42a0-8da6-f8eda4de4a6f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.740659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.742143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.748310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 384/760] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:48.749874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efe5d7-7ec7-4f13-a8c9-b3d4eb8b7980 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.750397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efe5d7-7ec7-4f13-a8c9-b3d4eb8b7980 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.750883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efe5d7-7ec7-4f13-a8c9-b3d4eb8b7980 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.752725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 385/761] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:48.753606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efe5d7-7ec7-4f13-a8c9-b3d4eb8b7980 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-39a6666c-91b6-430d-843e-9be094e685db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:48.765840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:48.766779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:48.767711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 377/762] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:48.768677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.768974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.769259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.787190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:48.788426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:48.863478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 378/763] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:48.865161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.880358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efe5d7-7ec7-4f13-a8c9-b3d4eb8b7980 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:48.926945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:48.928511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:48.929176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:48.930132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:48.939093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:48.941402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:48.961037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:48.962208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:48.963452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:48.965766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 386/764] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:48.966680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:48.996843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567c1d-39b7-4914-a475-18cdfce007e9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.039454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.040374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.040804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.041226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.042198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:49.043073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.045043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.061766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 379/765] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:49.062831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.078236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d135e40-da83-42ed-8a5e-2fcb945a6c83 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.121420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.122752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.123382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.123807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.125248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.126782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:49.143326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:49.144500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:49.145518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:49.148757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 387/766] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Apr 29 18:29:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:49.149824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.166515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4569db0-4c15-4a1e-bc98-2cbedc02ccad None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.200325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.201042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.201403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.201747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.202790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:49.202902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.204473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.218302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 380/767] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:49.219410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.285922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0902-0610-4abd-85a6-46a2bc7063a2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.320600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f7d5-8d5f-4530-9c0a-48817f887fef None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.321286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.322378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.322841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.323363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/9c539d6a3d1d49bcaadcea8970560c39/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.325566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=9c539d6a3d1d49bcaadcea8970560c39, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.327266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.344968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 388/768] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:49 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/9c539d6a3d1d49bcaadcea8970560c39/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:49.346340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.379975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.380787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.380988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.381263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.381991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:49.382324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.383774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.394681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 381/769] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:49.400486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.468363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83ac1-56e2-46e4-a1e6-7a212dc8a2cc None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.513229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.514583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.515082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.515605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.516693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=e399c8a0fd11423c8a70db4235228060) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:49.517215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.518943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.526631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 389/770] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/role_assignments?user.id=e399c8a0fd11423c8a70db4235228060&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:49.592690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233753a-8423-4555-95d3-38d1e80c2870 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.630230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.631302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.631794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.632284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.633246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:49.633758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.635688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcba7b8-08e0-4c95-8e4e-8967973947b8 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.641892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 382/771] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:49.647581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.690934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e77b-16d0-4459-beaa-37d9990e1728 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.691657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e77b-16d0-4459-beaa-37d9990e1728 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.692141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e77b-16d0-4459-beaa-37d9990e1728 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.694053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 383/772] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:49.700877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.701507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.701985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.719556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:49.721116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:49.798157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78af0-fcc0-44c2-81aa-ee52eafea0dc None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:49.810045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 384/773] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:29:49.832031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:49.832834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:49.833232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:49.833648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:49.834737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] RBAC: Adding query filter params (interface=public, service_id=f0cac93ee1d7468e8640f1a6c7bfea4c, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:49.835047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:49.835346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.836995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:49.845200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 390/774] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/endpoints?service_id=f0cac93ee1d7468e8640f1a6c7bfea4c&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:49.850245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:49.971188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7647a-e8a9-4b01-8d0c-6381b988e35e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.007202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50060-ff06-4707-bdac-b99c7b7c9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.008520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50060-ff06-4707-bdac-b99c7b7c9d67 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.008804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50060-ff06-4707-bdac-b99c7b7c9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.009080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50060-ff06-4707-bdac-b99c7b7c9d67 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.009760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50060-ff06-4707-bdac-b99c7b7c9d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.011479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef65ae9-86c5-4199-a2cd-687348f82df6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.011612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50060-ff06-4707-bdac-b99c7b7c9d67 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.016933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 391/775] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:50.058861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd56b-fa91-4b62-8b64-fa34ae46e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.059701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd56b-fa91-4b62-8b64-fa34ae46e64e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.059985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd56b-fa91-4b62-8b64-fa34ae46e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.060323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd56b-fa91-4b62-8b64-fa34ae46e64e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.076839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd56b-fa91-4b62-8b64-fa34ae46e64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-410cd56b-fa91-4b62-8b64-fa34ae46e64e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:50.084441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:50.085382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:50.086880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 385/776] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:50.087608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba0b7-3145-4f51-b725-0c1ff5b8ed21 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.087608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba0b7-3145-4f51-b725-0c1ff5b8ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.088283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba0b7-3145-4f51-b725-0c1ff5b8ed21 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.089481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 392/777] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:50.095137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.095462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.095696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.096092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba0b7-3145-4f51-b725-0c1ff5b8ed21 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.117129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:50.118748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:50.231789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba0b7-3145-4f51-b725-0c1ff5b8ed21 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.246053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 386/778] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:50.269616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.270675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.271200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.271720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.272800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:50.273880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.275478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.281846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.285693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 393/779] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:50.293015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.392067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b633-51ae-435c-a1a2-988223e6ff82 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.395565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61e93-c7a5-4beb-ba43-22276e4938c3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.426253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.427602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.428164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.428702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.429777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.430258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.430729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.431083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.431465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.432534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:50.446905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:50.448047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:50.448877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:50.449606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.449680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.452149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 387/780] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:50.460098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:50.474472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:50.475886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:50.476817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:50.476817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:50.476817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:50.476817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:50.479010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 394/781] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:50.488363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.597891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a000b-d4a1-4755-9165-0fb8434f47b5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.620470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5277175-0719-4972-ab19-22261ef8c692 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.653468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b96af-1053-4567-b617-470296468593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.654509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b96af-1053-4567-b617-470296468593 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.655000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b96af-1053-4567-b617-470296468593 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.655128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.655626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b96af-1053-4567-b617-470296468593 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.655761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.656041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.656317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.657051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:50.657310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b96af-1053-4567-b617-470296468593 None admin] RBAC: Adding query filter params (name=network) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:50.657421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.657922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b96af-1053-4567-b617-470296468593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.658713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.659780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b96af-1053-4567-b617-470296468593 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.671169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 395/783] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:50.671373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 388/783] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:50.676304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.676430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b96af-1053-4567-b617-470296468593 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.795211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e986-9ff3-4d69-b967-19f1c70f0dbb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.832914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b96af-1053-4567-b617-470296468593 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:50.844370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.845043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.845328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.845605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.846392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] RBAC: Adding query filter params (type=network) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:50.846615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.848018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.859605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 396/784] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:50.864753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:50.876794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:50.877935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:50.878422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:50.878902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:50.890925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:50.892842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:50.918481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:50.919758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:50.920726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:50.928970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 389/785] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:50.940086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:51.047495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb606-7a46-466f-884a-9ff6f03135ee None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:51.098578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45d82-f418-49b6-8bf0-59ac23f8cf33 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:51.132394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:51.132891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:51.133094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:51.133366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:51.133629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:51.134435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] RBAC: Adding query filter params (interface=public, service_id=409a24a0410e4476806b0a0eb5b8f1a1, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:51.134543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:51.134746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:51.135485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:51.135971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:51.136408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:51.137220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:51.137738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:51.139388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:51.153351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 397/786] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/endpoints?service_id=409a24a0410e4476806b0a0eb5b8f1a1&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:51.158585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:51.163221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 390/787] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Apr 29 18:29:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:51.165245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:51.275461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76973824-ef2b-4007-a3a2-6a9d2a7ffa29 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:51.308785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:51.309377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:51.309658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:51.309935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:51.310614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:51.312050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:51.317542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 398/788] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:29:51 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:51.353767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b8a14-438a-4673-ab59-c9ef1027d1ba None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:51.408582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:51.409427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:51.409714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:51.409995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:51.427486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:51.428989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:51.454509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:51.455543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:51.456867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:51.456867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:51.456867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:51.456867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:51.456867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 391/789] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:51.467147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:51.614713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc8614-c59b-4c63-972b-08707dfc0e31 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:51.663520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:51.664583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:51.665070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:51.665570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:51.666537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:51.667124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:51.668706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:51.686106 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 399/790] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:51.691716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:51.841951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc8c6-3127-4591-8acf-1b7d28847ffe None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:51.889265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:51.890005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:51.890288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:51.890567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:51.900139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:51.901606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-c7ee5dbe-6100-4b61-8977-2aed5a7c2da2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:51.916592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:51.917505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:51.919008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 392/791] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:51.924252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.009003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74bf2-d1ec-4c95-b448-971a556f691b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.009327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74bf2-d1ec-4c95-b448-971a556f691b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.009584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf74bf2-d1ec-4c95-b448-971a556f691b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.011468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 393/792] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:52.021003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.021300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.021590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.056130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:52.057328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:52.063583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13865b-d35c-4980-81a7-da96f8150ad3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.096919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:52.097582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.097860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.098133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.098918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:52.099246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:52.100751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:52.113509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 400/793] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:52.120061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.204545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 394/794] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:52.255821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.274193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21f58f-e489-49d1-93db-46153a02d4e1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.328036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f153a8-90d3-4084-9b77-6aaa07167970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:52.329275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f153a8-90d3-4084-9b77-6aaa07167970 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.329762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f153a8-90d3-4084-9b77-6aaa07167970 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.330277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f153a8-90d3-4084-9b77-6aaa07167970 None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/8e60e2dfa5814b699d107aa74f55c59f/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.336957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f153a8-90d3-4084-9b77-6aaa07167970 None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=8e60e2dfa5814b699d107aa74f55c59f, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:52.338485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f153a8-90d3-4084-9b77-6aaa07167970 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:52.360610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 401/795] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:52 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/8e60e2dfa5814b699d107aa74f55c59f/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:52.362235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d4cd-040f-4b7f-ac36-3d3dae2cdff4 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.362642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d4cd-040f-4b7f-ac36-3d3dae2cdff4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.362993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d4cd-040f-4b7f-ac36-3d3dae2cdff4 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.369348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 402/796] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:52.371269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.371671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.372482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.401510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae2531-8b97-49ff-b317-b9c0401dbc7e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.420291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:52.421875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:52.453866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:52.454758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.454988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.455298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.483725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:52.500040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:52.501042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:52.501885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:52.504174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 395/797] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:52.510270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.574101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 403/798] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:52.600120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.636411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199bfb-c780-4710-801c-0d5b6fd33935 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.708456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:52.709905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.710418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.710954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.711940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:52.712447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:52.714020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:52.737400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 396/799] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:52.743749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.744418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab52f7-294d-40f0-b1ba-8037e97d06e1 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.784654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:52.785457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.785739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.786009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.811990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:52.827140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:52.828079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:52.828902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:52.832584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 404/800] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:52.837638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:52.875132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58815404-f984-4171-850f-cb6f0081db37 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.913248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:52.914577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:52.914856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:52.915151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:52.936087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:52.937544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:52.969268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:52.970187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:52.971496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:52.971496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:52.971496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:52.971496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:52.971496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 397/801] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:52.977223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e0357-7c81-4567-ab1a-cd34e2330d14 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:52.977852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.013379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.014051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.014338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.014616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.015391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:53.016707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.018092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.033496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 405/802] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:53.044396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.166789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597c25-7c90-4f8f-b34d-a3446b81ffa3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.203134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d796-058a-4059-a6e6-f51671a3a31e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.230860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.231571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.232143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.232430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.232725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.233009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.233267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.233746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.234674 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:53.235216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.236818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.244367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.245820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.254518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 398/803] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:53.256495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:53.264918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:53.265832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:53.267179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:53.267179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:53.267179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:53.267179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:53.267179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 406/804] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:53.272131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.370440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c26b8-220f-4cb3-9e85-639e3f63d4ee None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.405629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.406427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.406710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.406982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.414899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.416372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.427683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92de2d-bda4-4e65-abf5-9cedac8602cd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-9f14b2ef-af9b-4f0e-a933-126aebe88344 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:53.431018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:53.431973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:29:53.432944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:53.442114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 399/805] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:53.443629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce107e8f-062e-4f63-89e0-71fc04e50dec None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.443918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce107e8f-062e-4f63-89e0-71fc04e50dec None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.444199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce107e8f-062e-4f63-89e0-71fc04e50dec None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.446099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 400/806] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:53.446881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce107e8f-062e-4f63-89e0-71fc04e50dec None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.465462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.466130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.466449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.466677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.467444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:53.467748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.469131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e203e9-d3fd-4d98-9027-4a9685015002 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.482767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 407/807] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:53.484097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.484386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.484660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.500767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:53.501944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:53.557575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce107e8f-062e-4f63-89e0-71fc04e50dec None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.575510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 408/808] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:53.576265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.602461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.603675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.605026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.606381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.607588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:53.607904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.609424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.634183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 401/809] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:53.635360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.718829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc2bb9-4363-4e5d-b80d-e6d3176fc495 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.732637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b37901-4f52-4450-a8d7-6db65899554f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.763947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.765789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.766285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.766778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.767730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.768567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.768852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.769130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.769877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.771766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.778892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.780769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:53.785404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:53.786407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 18:29:53.787274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:53.791784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 402/810] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:53.792756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:53.801708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:53.802642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:29:53.803612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:53.805063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 409/811] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:53.807397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:53.897765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945718e0-959a-456c-aa33-d2f4e21f57ab None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.909861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64c5f2-222d-47ac-980f-6963ee09f7e0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:53.933399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581befaf-f2f7-40fd-bcb8-c1f7ab328c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.933908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581befaf-f2f7-40fd-bcb8-c1f7ab328c05 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.934195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581befaf-f2f7-40fd-bcb8-c1f7ab328c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.934526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581befaf-f2f7-40fd-bcb8-c1f7ab328c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.944721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:53.946230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:53.946784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:53.947346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:53.948244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:53.948749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:53.950349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:53.955565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 410/812] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:53.956592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.008909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581befaf-f2f7-40fd-bcb8-c1f7ab328c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.010612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581befaf-f2f7-40fd-bcb8-c1f7ab328c05 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.068977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710e7d6-950f-47da-b7f9-1780eaee59d1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.102511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.103485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.103772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.104052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.104902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:54.105199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.106639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.109828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 403/813] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:29:54.111049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5699a-340d-411f-a35d-0ee37044d6d8 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.111364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5699a-340d-411f-a35d-0ee37044d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.111648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5699a-340d-411f-a35d-0ee37044d6d8 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.113062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 404/814] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:54.113686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5699a-340d-411f-a35d-0ee37044d6d8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.128620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 411/815] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Apr 29 18:29:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:54.128620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.216711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5699a-340d-411f-a35d-0ee37044d6d8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.234841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299550-9c54-456c-9c27-60c5d9103ed3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.250443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.251135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.251425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.251703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.252419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:54.252725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.254120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ac88-83e5-4484-b042-c97e5ae9e8c6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.259829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 405/816] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:54.261340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.261633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.261912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.274566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.275384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.275662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.275938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.277643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:54.278829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:54.285809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.287285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:54.305577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:54.306675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:54.312510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:54.312510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:54.312510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:54.312510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:54.312510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 412/817] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:54.312510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.351234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 406/818] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:54.352059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.429958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776ff6-d997-4bac-a987-930ce64c1c44 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.447576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f53a5-5658-4dc7-ac5b-0d08bf42ba03 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.472364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.473347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.473796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.474220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.481414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.482088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.482377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.482658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.483464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.484794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.485700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.487351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.508063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 407/819] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:29:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:54.509048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:54.509560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:54.510689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:54.511612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:54.511612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:54.511612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:54.511612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:54.513630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 413/820] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:54.514759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.637448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779bf64-1d19-4592-8c6d-4f78e56ef35c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.652603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59436ee-3a68-4e95-b89a-e47fc1a28d9b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.675102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.676090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.676448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.676839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] PATH_INFO: `/v3/services/network` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.677554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.679043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.691251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.692241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.692738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.693206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:54.693362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:54.694308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:54.695499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 414/821] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:54.697468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:54.698018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.699625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.700396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.714000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 408/822] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:54.719473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.815727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fddbe-1bf8-4d75-aa17-2f15d867e47a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.823030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7247f-df90-4e89-881d-5ce03a994448 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.849303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.850203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.850480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.850753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.852117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:54.852421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.853795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.857028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:54.857872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.858301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.858745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.859628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:54.860079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:54.861572 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d88d5-41d9-4cec-a1a7-2e36c70313c4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:54.865054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 415/823] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:54.865861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.866541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 409/824] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:54.868038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47900ad-47d0-4abd-a24d-c6a82d747e71 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:54.868455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47900ad-47d0-4abd-a24d-c6a82d747e71 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:54.868876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47900ad-47d0-4abd-a24d-c6a82d747e71 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:54.872000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 410/825] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:54.872724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47900ad-47d0-4abd-a24d-c6a82d747e71 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:54.973026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2990546-2bc4-4458-87d8-1263f827b3e8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:54.977746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47900ad-47d0-4abd-a24d-c6a82d747e71 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.014592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.015491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.015775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.016047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.016388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.017534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.017828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.018107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.023772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.025218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.025446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.026887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:55.039221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:55.040059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:55.040960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 411/826] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:55.042031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-c1c839b9-5c08-41fe-aeec-a8c1c530dc66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:55.043980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:55.044844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:55.045704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 416/827] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:55.046750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.047035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.047339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.064699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:55.066139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:55.138008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 417/828] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:55.139207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.141062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77cc4-8951-4ad8-a699-ef1fb804d7d0 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.177779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.178442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.178719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.178996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.179754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] RBAC: Adding query filter params (type=network) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:55.180055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.181417 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.190373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 412/829] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:55.190373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.249775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17539-6ad3-4817-a2b4-6ef54e20b8a4 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.283756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.284426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.284710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.284986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.285779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:55.285952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167acc-c70d-4f88-9874-50eeba4fbbbb None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.286140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.287550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.299627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 418/830] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:55.300532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.327560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.328473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.328761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.329050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.329834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:55.330258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.331609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.343978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 413/831] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:55.349513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.395903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475599e4-ba5c-454c-bb0d-6a99bae8497b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.428710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.429531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.429809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.430080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.441363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:55.448724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af61d5-5bbf-41d9-a3fa-e28abc997636 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:55.449451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:55.450395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:55.451292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 419/832] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:55.452039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.488218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.489198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.489700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.490190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.491147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.492698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.510979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 414/833] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:29:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:29:55.512187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.555633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4de95-cf79-4e4e-b9af-41dc54702463 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.602569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.604554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.605094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.605598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/e399c8a0fd11423c8a70db4235228060/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.624443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=e399c8a0fd11423c8a70db4235228060, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.627070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.632215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c83a5-b0af-4fab-b71b-a2b7a0c2fe48 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.651629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 420/834] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:29:55 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/e399c8a0fd11423c8a70db4235228060/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:29:55.651629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.709013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.709775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.710069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.710391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.711374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=9c539d6a3d1d49bcaadcea8970560c39) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:55.711705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.713284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.728823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 415/835] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/role_assignments?user.id=9c539d6a3d1d49bcaadcea8970560c39&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:55.811229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e98b-c491-45e0-a1dc-51871e8285a2 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:55.850539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:55.851414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:55.851579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:55.851859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:55.852629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:55.852934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:55.854347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:55.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 421/836] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:55.871576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:55.996985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee186eb-be7f-4f0c-b4df-f03bc7e08a35 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:56.035871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:56.037075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.037544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.037997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.050581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:56.052418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:56.070525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:56.071482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:56.072389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:56.072389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:56.072389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:56.072389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:56.074329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 416/837] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:56.079787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:56.180375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5194a-366c-4713-b77d-0bbaf671cef0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:56.213204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:56.213868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.214153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.214433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.215181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:56.215493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:56.216900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:56.230073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 422/838] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:56.235436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:56.338373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382cfc0-0cda-4744-b2b5-e4ebf2de45d1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:56.371940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:56.373021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.373510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.373975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.381708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:56.383388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:56.397513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:56.398970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 29 18:29:56.400030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:56.402244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 417/839] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:29:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:56.411128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:56.518188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e596e-7b06-45ba-b997-6d5dcee17a1e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:56.553226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:56.553908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.554240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.554580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.555463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:56.555825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:56.557277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:56.579488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 423/840] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Apr 29 18:29:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:56.580971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:56.684700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94cb96-9fa2-4349-9576-5a63a1e4a081 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:56.719044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b935b9c-cbd7-4209-83a9-d68b444f43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:56.720119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b935b9c-cbd7-4209-83a9-d68b444f43b9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.720612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b935b9c-cbd7-4209-83a9-d68b444f43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.721088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b935b9c-cbd7-4209-83a9-d68b444f43b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.793445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b935b9c-cbd7-4209-83a9-d68b444f43b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:56.795295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b935b9c-cbd7-4209-83a9-d68b444f43b9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:56.895494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 418/841] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:29:56.907187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:56.930170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b11da1-efb2-4d52-8f08-f3312d746f1b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.930815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b11da1-efb2-4d52-8f08-f3312d746f1b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.931499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b11da1-efb2-4d52-8f08-f3312d746f1b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.933296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 419/842] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:56.938920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:56.939497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:56.939993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:56.957531 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:56.959060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:57.003693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bc584-208d-4e8a-abb7-6d2fd01efe1d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.041613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.042416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.042694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.042975 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.050695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 420/843] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:57.059146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.060786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.071298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:57.081734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:57.082599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:57.083522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:57.083522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:57.083522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:57.083522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:57.083522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 424/844] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:57.089721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.187339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c30e8-f608-4d6d-b612-1b1841661e64 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.195929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22a658-05fc-4505-91c8-ce98c7fa3c86 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.229153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.229659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.230435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.230546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.230798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.231077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.231446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.231764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.232258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.233167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:57.233270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.233939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.235553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:57.247622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:57.248620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:29:57.249441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:57.254853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 421/845] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:57.254853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.255389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 425/846] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:57.256461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.368849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885cf9e-6b2a-4797-b76c-88b14f80d965 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.369212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437493b-44de-4a88-8e69-7ee77d3fb2b2 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.402495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.403195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.403485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.403763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.404472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:57.404778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.406151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.409678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.410511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.410835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.411187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.411655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 422/847] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:57.418421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.425105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.427458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:29:57.446411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:57.447355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:29:57.448254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:57.449125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 426/848] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:57.455152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.548450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94d1c-5079-455c-b6d0-2fee7f49e092 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.557935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550ee52-a4bf-4978-aa43-d51e58bd0957 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.582536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05398043-fd89-41db-98c5-00570272d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.583340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05398043-fd89-41db-98c5-00570272d07b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.583752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05398043-fd89-41db-98c5-00570272d07b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.584110 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05398043-fd89-41db-98c5-00570272d07b None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.585003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05398043-fd89-41db-98c5-00570272d07b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:57.585427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05398043-fd89-41db-98c5-00570272d07b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.586906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05398043-fd89-41db-98c5-00570272d07b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.599154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 423/849] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:57.599351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.599351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.599351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.599351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.599666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:57.599666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.599810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4373f-0fbf-4ef6-8ea9-f9f9f059812f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.615380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 427/850] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:57.621772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05398043-fd89-41db-98c5-00570272d07b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:57.735451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05398043-fd89-41db-98c5-00570272d07b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:57.772518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:57.773615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:57.774099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:57.774573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:57.775703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=8e60e2dfa5814b699d107aa74f55c59f) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:57.776276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:57.777936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc69ac-7105-41ae-b5f4-0b01e45b7936 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:57.785062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 424/851] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:29:57 2022] GET /identity/v3/role_assignments?user.id=8e60e2dfa5814b699d107aa74f55c59f&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:58.058494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e616-735c-4c1d-b045-494df4949bd6 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.058981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e616-735c-4c1d-b045-494df4949bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.058981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e616-735c-4c1d-b045-494df4949bd6 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.060600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 428/852] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:58.065986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20136-f21a-4ee2-94a3-15896d77f8de None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.066386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20136-f21a-4ee2-94a3-15896d77f8de None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.066550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20136-f21a-4ee2-94a3-15896d77f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.083184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ede20136-f21a-4ee2-94a3-15896d77f8de None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:58.084349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ede20136-f21a-4ee2-94a3-15896d77f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:58.155217 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 425/853] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:58.169014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590ed11-d13f-4662-8185-5ce1f384e99b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.169302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590ed11-d13f-4662-8185-5ce1f384e99b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.169637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590ed11-d13f-4662-8185-5ce1f384e99b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.171144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 429/854] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:29:58.176437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.176726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.177003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.179592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590ed11-d13f-4662-8185-5ce1f384e99b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.196204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:58.198362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:29:58.275137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 426/855] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:29:58.292100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.310873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590ed11-d13f-4662-8185-5ce1f384e99b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.352240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.353528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.354121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.354567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.372949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:29:58.380832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:58.381755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:29:58.383769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:58.387241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 430/856] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:58.388705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.416438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48503-89f0-4378-8ce7-57338a2b4642 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.462808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.463983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.464452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.464910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.465751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:58.467780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:58.484355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:58.485354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:58.486188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 427/857] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:58.493860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.499069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb76c-fdbf-4237-bd40-1eff21f75579 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.534152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.534871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.535184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.535467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.536219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:58.536527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:58.538189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:58.551516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 431/858] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:58.552458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.602401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e744f7-1bbc-45cd-9647-82445a3ce2c3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.637804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.638874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.639390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.639874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.640801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:58.641311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:58.642892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:58.652587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 428/859] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:58.654170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.655825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb28f6-ace3-46db-bb08-4b7765ed5562 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.690618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.691098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.691426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.691706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.703679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:58.704909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:58.722497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:58.723686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:58.724639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:58.724639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:58.724639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:58.724639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:58.728385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 432/860] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:29:58.729267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:58.762285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c738-04bf-4cec-955e-be4c5e776d14 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.797723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.798795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.799313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.799794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.800800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:58.801328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:58.802900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:58.815227 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 429/861] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:29:58.840574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f2d4e-3ea0-479e-a0d9-55f2afae2d1f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:58.876763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:58.877853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:58.878347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:58.878850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:58.879833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:58.880382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:58.884045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:58.898312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 433/862] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:58.904420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:59.012693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22223-54fd-4bda-bbc0-9247096296db None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:59.049228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:59.050049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.050329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.050604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.058651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:59.060116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:29:59.074371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:59.075751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:29:59.077262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 430/863] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:29:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:59.081441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:59.182612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d483c5-a820-484f-9345-642defe7e87c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:59.215651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:59.216325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.216607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.216883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.217720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:59.218027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:59.219478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:59.237741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 434/864] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Apr 29 18:29:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:59.243889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:59.341967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152485c9-483f-4bc4-a5db-238582a03bd1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:59.374703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:59.375392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.375678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.375958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.447141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:59.449062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:59.551097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 431/865] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:29:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:29:59.556426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:59.661419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155076b-3922-42f8-905b-b39b829229a5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:59.695708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:59.696505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.696853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.697128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.708070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:59.709483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:29:59.729775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:29:59.730743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:29:59.731655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:29:59.731655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:29:59.731655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:29:59.731655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:29:59.735606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 435/866] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:29:59.737311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:59.845240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d628e-ddb0-4751-a9ab-af0b17f481d9 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:29:59.879615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:29:59.880294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.880581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.880867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.881599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:29:59.881917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:29:59.885381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108e291-1f09-42c7-a6b3-7b33d31913a2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:29:59.897174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 432/867] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:29:59.902905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:29:59.917428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48e2e-3d3b-4a7d-8364-2a4b1528ea6a None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.917745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48e2e-3d3b-4a7d-8364-2a4b1528ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.917968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48e2e-3d3b-4a7d-8364-2a4b1528ea6a None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.919968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 433/868] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:29:59.924369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:29:59.924662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:29:59.924946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:29:59.941469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:29:59.942658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:00.008086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c4eb8-9215-4214-ba73-edcfdc71064d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.019183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 434/869] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:29:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:00.036254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:00.043253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.044069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.044352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.044624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.051925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.053370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:00.073706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:00.074812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:00.075940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:00.078957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 436/870] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:00.088311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:00.167538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61867469-5471-4e15-9a30-ea5bbcd1da05 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.199855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184066db-3b60-4dec-a14b-3e3b4df538a5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.203319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07022fb2-ec37-4c49-91e8-cf4350129947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.204177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07022fb2-ec37-4c49-91e8-cf4350129947 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.204604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07022fb2-ec37-4c49-91e8-cf4350129947 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.205020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07022fb2-ec37-4c49-91e8-cf4350129947 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.205883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07022fb2-ec37-4c49-91e8-cf4350129947 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.207483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07022fb2-ec37-4c49-91e8-cf4350129947 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.235135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 435/871] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:00 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:30:00.235135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1af9d-4cd0-41d3-bfc1-ab21df9cbd55 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.235135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1af9d-4cd0-41d3-bfc1-ab21df9cbd55 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.235135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1af9d-4cd0-41d3-bfc1-ab21df9cbd55 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.235135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 436/872] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:00.236678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.236951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.237231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.256557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.257006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:00.257805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.258159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.258378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.259208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:00.259622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.259916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:00.261369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.280216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 437/873] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:00.280907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:00.339212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 437/874] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:00.357958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:00.387938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42082-c584-417b-a41e-4d615170fb3d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.425948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.426608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.427048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.427373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.428683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=e399c8a0fd11423c8a70db4235228060) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:00.429053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.431214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.443546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 438/875] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:00 2022] GET /identity/v3/role_assignments?user.id=e399c8a0fd11423c8a70db4235228060&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:00.478003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b40ea-5669-4b24-908a-0ccfdbd67ce1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.518163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.519319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.519746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.520189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.521003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.522550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:00.535631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:00.536888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:00.537892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:00.541128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 438/876] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:00.547209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:00.654102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad7cc5-c74d-4825-9d5f-58f11dd04da3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.688717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.689377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.689663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.689936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.690633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:00.690936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.692335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207a79-07e6-4de3-9173-d60e9be1e55b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.697265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 439/877] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:00.702860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:00.806858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4522a18-dac6-4291-afbb-269bbd3e3b04 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:00.840052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:00.840723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:00.841007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:00.841286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:00.841993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:00.842297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:00.843697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeee213-4dbe-4871-b71c-85c4a9c99c0d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:00.848606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 439/878] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:01.302922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12eaa1-4128-4cd1-bdca-69f57def89da None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:01.303464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12eaa1-4128-4cd1-bdca-69f57def89da None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:01.303572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12eaa1-4128-4cd1-bdca-69f57def89da None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:01.305192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 440/879] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:01.310356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b4e8b-68df-422c-9cec-04aa19ae92ea None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:01.310767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b4e8b-68df-422c-9cec-04aa19ae92ea None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:01.310951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b4e8b-68df-422c-9cec-04aa19ae92ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:01.327999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-898b4e8b-68df-422c-9cec-04aa19ae92ea None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:01.329182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-898b4e8b-68df-422c-9cec-04aa19ae92ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:01.399218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 440/880] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:01.420037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12eaa1-4128-4cd1-bdca-69f57def89da None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:01.527558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12eaa1-4128-4cd1-bdca-69f57def89da None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:01.561594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a757-fe94-4d6c-a1fd-633aa6c34dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:01.562592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a757-fe94-4d6c-a1fd-633aa6c34dbc None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:01.563076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a757-fe94-4d6c-a1fd-633aa6c34dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:01.563579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a757-fe94-4d6c-a1fd-633aa6c34dbc None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:01.564526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a757-fe94-4d6c-a1fd-633aa6c34dbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:01.566116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a757-fe94-4d6c-a1fd-633aa6c34dbc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:01.584205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 441/881] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:01 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:02.599959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768e8b0-6c10-4271-9608-3102184ecc7c None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:02.600474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768e8b0-6c10-4271-9608-3102184ecc7c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:02.600591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768e8b0-6c10-4271-9608-3102184ecc7c None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:02.602178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 441/882] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:02.607446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d882-bcb0-4ec2-898d-75ae62495e31 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:02.607868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d882-bcb0-4ec2-898d-75ae62495e31 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:02.608039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d882-bcb0-4ec2-898d-75ae62495e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:02.625408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0105d882-bcb0-4ec2-898d-75ae62495e31 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:02.626603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0105d882-bcb0-4ec2-898d-75ae62495e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:02.704580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 442/883] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:02.727347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768e8b0-6c10-4271-9608-3102184ecc7c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:02.834027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768e8b0-6c10-4271-9608-3102184ecc7c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:02.863007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574049-d881-4ec8-aa3c-f27b5999ca56 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:02.863659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574049-d881-4ec8-aa3c-f27b5999ca56 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:02.864194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574049-d881-4ec8-aa3c-f27b5999ca56 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:02.865783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 443/884] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:02.870300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:02.870300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:02.870300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:02.870300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:02.870662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:02.871844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:02.872321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:02.872832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:02.873313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:02.883804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:02.884909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:02.886086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 442/885] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:30:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:02.891529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:02.894448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:02.895884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:02.967851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 444/886] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:02.995085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:02.996618 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1730c-9e4b-487a-ab24-7cdbfe79841c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.036355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.037030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.037322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.037604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.038831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:03.039166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.040544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.045588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 443/887] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:30:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:03.051029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.102819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2938-a073-498b-8360-fffd8aa90dca None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.137845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75d9f-53d7-40fe-a7f8-0c4863d6b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.139530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75d9f-53d7-40fe-a7f8-0c4863d6b651 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.140311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75d9f-53d7-40fe-a7f8-0c4863d6b651 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.140903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75d9f-53d7-40fe-a7f8-0c4863d6b651 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.151608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75078-ee7f-492c-abb4-9b0e49702cf6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.155537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f75d9f-53d7-40fe-a7f8-0c4863d6b651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-c3f75d9f-53d7-40fe-a7f8-0c4863d6b651 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:03.166855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:03.167917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:03.168767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:03.171261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 445/888] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Apr 29 18:30:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:03.172749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a1330-ceb9-4683-8638-db38e715d343 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.173198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a1330-ceb9-4683-8638-db38e715d343 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.174031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a1330-ceb9-4683-8638-db38e715d343 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.176023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 446/889] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:03.180968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.181254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.181585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.187393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.188070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.188355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.188635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.189347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:03.189657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.191031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.196858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 444/890] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:03.199187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.199318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:03.199318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:03.265777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 447/891] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:03.266876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.317585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c79a37-6184-4fa0-90e8-86182da9f572 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.356214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.357329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.357616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.358044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.358801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:03.359127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.360491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.368017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5536407-847c-4a13-9bc1-61ae5347a36e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.372922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 445/892] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:03.372922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.405786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.406442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.406723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.406999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.407810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] RBAC: Adding query filter params (interface=public, service_id=da4d00811eac4be0ac71b23277cd369d, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:03.408118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.409489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.415135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 448/893] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/endpoints?service_id=da4d00811eac4be0ac71b23277cd369d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:03.415912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.480949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee92b7-e5bc-4c96-801a-5c23416b41e0 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.514689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c77b-746e-4714-9786-344e3bc88a06 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.521233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c100b-92c4-4659-9842-da7254088319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.522541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c100b-92c4-4659-9842-da7254088319 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.523541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c100b-92c4-4659-9842-da7254088319 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.523963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c100b-92c4-4659-9842-da7254088319 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.525182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c100b-92c4-4659-9842-da7254088319 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.527313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c100b-92c4-4659-9842-da7254088319 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.545316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 446/894] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:03 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:03.546371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c100b-92c4-4659-9842-da7254088319 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.558294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.559314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.559722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.560099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.575877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.578208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:03.603370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:03.604514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:03.605436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:03.605436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:03.605436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:03.605436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:03.611307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 449/895] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:03.616421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.665618 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c100b-92c4-4659-9842-da7254088319 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.701749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0387-745f-470e-9bdd-819905879070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.702541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0387-745f-470e-9bdd-819905879070 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.702834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0387-745f-470e-9bdd-819905879070 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.703131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0387-745f-470e-9bdd-819905879070 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.704185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0387-745f-470e-9bdd-819905879070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.705275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b0387-745f-470e-9bdd-819905879070 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.712692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 447/896] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:30:03.734116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f753a-e10e-42da-aa9e-f4aff9753f8f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.776868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.777482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.777769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.778047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.778802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:03.779141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.780644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b884a-682c-44d9-910c-37e8e1af142b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.793804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 450/897] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:03.799522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0387-745f-470e-9bdd-819905879070 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:03.909456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0387-745f-470e-9bdd-819905879070 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:03.921069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a058c-89be-4043-a855-197a8a201c7a None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.921401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a058c-89be-4043-a855-197a8a201c7a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.921673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a058c-89be-4043-a855-197a8a201c7a None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.923471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 451/898] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:03.929419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.929721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.929988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.952071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:03.953270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:03.953569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:03.954394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:03.954688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:03.954964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:03.963577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:03.965034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:03.979899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:03.980886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:03.981850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 448/899] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:03.986740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.027935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 452/900] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:04.050391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.099545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8483e-d93c-4f80-965d-f3c74ffbcffd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.133922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.134860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.135580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.136015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.137007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:04.137478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.139063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.153068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5ced-ee35-427e-a231-c6c621212012 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.157330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 449/901] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Apr 29 18:30:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:04.164938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.195080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.196515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.196805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.197085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.197909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.200018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:04.216095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:04.217088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:30:04.217918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:04.218705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 453/902] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:04.224145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.284368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d38a1-1c78-41e2-b237-34c73afd227b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.321499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.322519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.323034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.323558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.335616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6b640-7200-4330-8319-0c8c0e708650 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.376867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.377647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.377940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.378226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.379140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:04.379474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.381511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.391142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 454/903] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:04.393484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.406077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.407552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.519815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 450/904] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:04.526124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda587d-143b-4e72-bbf6-5e526f47d704 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.526316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.563223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.563819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.564099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.564374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.565077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:04.565417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.566919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.577076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 455/905] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:04.578089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.628015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c933d-2a63-4e54-875d-e261f67a7f51 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.662371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.663239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.664048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.664331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.674837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.676334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.678581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af496e-4975-44c7-b0c9-1cf1345950f7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:04.694483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:04.696547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:04.698697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:04.698697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:04.698697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:04.698697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:04.703151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 451/906] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:04.703151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.712325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.712992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.713278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.713555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.714396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] RBAC: Adding query filter params (interface=public, service_id=db05f1e312914e6d820e2a44f07f6613, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:04.714656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.716085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.721480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 456/907] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/endpoints?service_id=db05f1e312914e6d820e2a44f07f6613&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:04.727138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.825801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d65e3-b204-469d-a1a2-88b05edd1079 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.840962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db654-6edc-444e-948f-73f958db93a5 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:04.866998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.867699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.867973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.868264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.869004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:04.869485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.870852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.887638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 452/908] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:04.889905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:04.895648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:04.896313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:04.896600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:04.897538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:04.897538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:04.899611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:04.914791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 457/909] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:30:05.007714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a4c4c-8369-4c69-8f57-9be33204a229 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:05.045031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:05.046272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:05.046767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:05.047288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:05.055351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:05.057167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:05.073291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:05.074285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:05.075220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:05.082682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 453/910] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:05.084405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:05.194962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6ad1-ded7-4c91-9b74-f7aec9f63fb0 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:05.228719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:05.229382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:05.229662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:05.229934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:05.230768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:05.231075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:05.232572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9960ba-3656-4220-99b2-3a9ca15e571e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:05.245263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 458/911] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:05.251312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:05.353185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce14a0-76e3-451c-9272-f1f825fd6230 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:05.388744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:05.389886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:05.390449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:05.390931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:05.392163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] RBAC: Adding query filter params (role.id=0aed4e1b4d81481e81e6ba983c8ea9be, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=e399c8a0fd11423c8a70db4235228060) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:05.392743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:05.394403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af427313-a0cc-48e4-b684-3e2f6c145aea None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:05.407249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 454/912] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:05 2022] GET /identity/v3/role_assignments?user.id=e399c8a0fd11423c8a70db4235228060&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=0aed4e1b4d81481e81e6ba983c8ea9be => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:05.952945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762c88-ebe1-46cf-9690-e3a072317747 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:05.953486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762c88-ebe1-46cf-9690-e3a072317747 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:05.953486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762c88-ebe1-46cf-9690-e3a072317747 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:05.955219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 459/913] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:05.960918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ab2c-cfcc-45b2-9681-257aa9df5f71 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:05.961311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ab2c-cfcc-45b2-9681-257aa9df5f71 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:05.961492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ab2c-cfcc-45b2-9681-257aa9df5f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:05.979054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b5d0ab2c-cfcc-45b2-9681-257aa9df5f71 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:05.980281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b5d0ab2c-cfcc-45b2-9681-257aa9df5f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:06.047286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 455/914] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:06.071553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762c88-ebe1-46cf-9690-e3a072317747 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.090166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34470-5bd4-4340-8cab-0a4df3cde41b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.090480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34470-5bd4-4340-8cab-0a4df3cde41b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.090743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34470-5bd4-4340-8cab-0a4df3cde41b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.092449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 456/915] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:06.100597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.100924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.101206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.118271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:06.119597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:06.191136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 457/916] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:06.199250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762c88-ebe1-46cf-9690-e3a072317747 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.210093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.245210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.246180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.246465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.246766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.248012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.249403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:06.265068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:06.266100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:06.267757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 460/917] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:06.272472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.335779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54eed2-11ed-44f4-a0e4-6fdba7b9e246 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.375738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.376576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.376865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.377145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.377806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.379763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.393466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802293c-480a-4ed7-8915-6021dec51d35 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:06.395325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:06.396348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:06.397225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 458/918] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:06.408543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.439756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.440541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.440904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.441289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.442081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:06.442508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.444013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.454190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 461/919] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:06.455528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.537428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f9e33-93ea-4656-a391-ef5c73718a52 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.560683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de310b-5f31-4868-a423-4b2a0f7fb305 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.584132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.585557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.586022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.586711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.587788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:06.588252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.590312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.596237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.597021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.597138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 459/920] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:06.599438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.599865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.601272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:06.601731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.603363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.604171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.609948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 462/921] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:06.615706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.717813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4a36-8cfa-4d2c-8737-ec7427552433 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.739615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000432-4cb8-48b0-97a1-3ddef226a61d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.761153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.762121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.762412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.762691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.763468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:06.763909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.765902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.775273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 460/922] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:06.778179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.778958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.779882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.780370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.780849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.781885 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] RBAC: Adding query filter params (interface=public, service_id=6f522b1b51794679a765ee0f46390ded, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:06.782401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.784018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.790834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 463/923] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/endpoints?service_id=6f522b1b51794679a765ee0f46390ded&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:06.795830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:06.893370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7d45-b461-4f40-891d-44fd0b925b45 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.910609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458815-098b-4986-ab18-8e9388ec6aa4 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:06.936243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e239f7a-3ee5-4d29-9ce8-2c792e97c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.936931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239f7a-3ee5-4d29-9ce8-2c792e97c206 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.937552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239f7a-3ee5-4d29-9ce8-2c792e97c206 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.937839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e239f7a-3ee5-4d29-9ce8-2c792e97c206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.938881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e239f7a-3ee5-4d29-9ce8-2c792e97c206 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.940491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e239f7a-3ee5-4d29-9ce8-2c792e97c206 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.948157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65270820-b3ae-465c-9753-3c59ff80646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:06.949091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270820-b3ae-465c-9753-3c59ff80646a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:06.949645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270820-b3ae-465c-9753-3c59ff80646a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:06.950145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270820-b3ae-465c-9753-3c59ff80646a None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:06.951325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65270820-b3ae-465c-9753-3c59ff80646a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:06.952849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65270820-b3ae-465c-9753-3c59ff80646a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:06.965816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 464/924] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:30:06 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:30:06.966473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 461/925] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:30:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:07.221604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53e610-ceb6-40e0-a8d9-3c7387ad287f None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.221981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53e610-ceb6-40e0-a8d9-3c7387ad287f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.222162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53e610-ceb6-40e0-a8d9-3c7387ad287f None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.223850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 465/926] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:07.229276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.229756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.230260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.249330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:07.250537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:07.324365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 462/927] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:07.347309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53e610-ceb6-40e0-a8d9-3c7387ad287f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:07.449024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53e610-ceb6-40e0-a8d9-3c7387ad287f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:07.484272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:07.485383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.485904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.486327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.487166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:07.488807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:07.506795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:07.508358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:07.509434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 466/928] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Apr 29 18:30:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:07.515061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:07.615266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff871e9-e13c-444a-82e6-2abe7d0eabe6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:07.649772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:07.650453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.650738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.651025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.651772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:07.652084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:07.653454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fefca-db25-4468-8741-5d2d863dcec4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:07.658456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 463/929] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:07.664229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:07.685697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfb60-abe6-4c40-a5e4-b4f40023c34d None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.685973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfb60-abe6-4c40-a5e4-b4f40023c34d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.686250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dfb60-abe6-4c40-a5e4-b4f40023c34d None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.687880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 464/930] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:07.692688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.692981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.693265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.712841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:07.714041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:07.767047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef43a0a-d27d-4fd3-bdf4-85ab25e3724a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:07.799389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 465/931] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:07.800321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:07.801247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.801725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.802194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.803119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:07.803639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:07.805727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:07.815419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:07.815787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 467/932] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:07.816814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:07.915100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc47c-d070-4d9c-ae7e-81a6b9767312 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:07.915769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e025805-6f6e-4435-a555-4aeea85041da None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:07.949829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:07.950314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:07.951080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.951216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:07.951474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.951751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.952129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:07.952591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:07.953688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:07.955618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:07.961884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:07.970212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:07.972050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:07.973200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:07.977287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 466/933] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Apr 29 18:30:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:07.979051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:07.991986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 468/934] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:30:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:08.098203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18237f8-3721-4a8c-b9c3-71af7c655bd1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:08.143230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:08.144320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:08.144823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:08.145304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:08.146262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:08.146779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:08.148527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:08.158382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 467/935] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:30:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:08.165880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:08.271721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab53e9-0ba5-4013-922a-6d66bb14182b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:08.305874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:08.306670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:08.306948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:08.307248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:08.317656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:08.319096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:08.336167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:08.337050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:08.338025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:08.338025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:08.338025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:08.338025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:08.338025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 469/936] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:08.343296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:08.449237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796fa0-630b-4f2f-bc25-5fed58cf3bac None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:08.483304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:08.483975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:08.484300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:08.484581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:08.485300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:08.485602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:08.487018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:08.499723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 468/937] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:08.505204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:08.603405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e4b2d-22f3-42c5-b8f5-6fc91e5eb4f1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:08.639326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:08.640155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:08.640443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:08.640723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:08.648984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:08.650437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:08.665669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:08.666626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:08.667571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 470/938] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:30:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:08.672564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:08.771261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eb863-df09-4c5a-8a69-3f88397b6a13 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:08.805070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:08.805749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:08.806029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:08.806300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:08.807171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:08.807558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:08.808983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:08.827097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 469/939] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Apr 29 18:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:08.832644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:08.936676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba263-1b8a-48b7-9e57-48cf94094775 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:08.972318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:08.973444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:08.973905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:08.974369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:08.985300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:08.987013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:09.004769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:09.006175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:09.007647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:09.007647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:09.007647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:09.007647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:09.009619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 471/940] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:09.015534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.122290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b36e-bbc5-4c06-8f3b-370c2f42cbcd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.167135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.167135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.167135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.167135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.167569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:09.167569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.167569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.180104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 470/941] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:09.187139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.309177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb46a9-811b-404b-aa22-53d2556f7a07 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.347146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.347146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.347146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.347146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.353302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.354755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-927f0c60-ff49-452d-87bb-c996ce865578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:09.369463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:09.370422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:09.371767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 472/942] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:09.376792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.390702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7278b-b329-413a-912b-0f42c606e9a8 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.390980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7278b-b329-413a-912b-0f42c606e9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.392863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7278b-b329-413a-912b-0f42c606e9a8 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.392863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 473/943] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:09.401811 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dad026-7516-405d-886c-8ff20fc588af None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.402103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dad026-7516-405d-886c-8ff20fc588af None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.402381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dad026-7516-405d-886c-8ff20fc588af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.430587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f5dad026-7516-405d-886c-8ff20fc588af None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:09.431810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f5dad026-7516-405d-886c-8ff20fc588af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:09.538849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe493d44-e81b-47a5-afc4-e89d32342ee7 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.546787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 474/944] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:09.548426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e87ea-e45f-444e-b616-5974d16f2b09 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.549114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e87ea-e45f-444e-b616-5974d16f2b09 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.549609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e87ea-e45f-444e-b616-5974d16f2b09 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.551641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 475/945] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:09.568598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.568884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.569166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.586207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.587636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.588119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.588598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.589595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:09.590119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.591788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.593351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:09.594518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:09.611985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 471/946] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:09.611985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.681805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 476/947] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:09.683078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.740085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef225f-236c-4e56-90be-591fb84b305f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.773496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.774313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.774595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.774869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.775571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.776940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.786290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07790e-41b0-417d-b5f7-bab3ca4647ef None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:09.789274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:09.790299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:09.791174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:09.795375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 472/948] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:09.796088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.820769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.821653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.821937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.822214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/e399c8a0fd11423c8a70db4235228060/roles/0aed4e1b4d81481e81e6ba983c8ea9be` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.824461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=e399c8a0fd11423c8a70db4235228060, role_id=0aed4e1b4d81481e81e6ba983c8ea9be)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.825911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.840531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 477/949] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:30:09 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/e399c8a0fd11423c8a70db4235228060/roles/0aed4e1b4d81481e81e6ba983c8ea9be => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:30:09.841343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:09.929069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53d319-be10-468d-92a3-43514f29af47 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.950985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4916a0-8597-454d-b5fd-20cc9bf9a528 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:09.975520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.977634 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.978203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.978640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.979712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.981932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:09.984610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING keystone.server.flask.common [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 29 18:30:09.993308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:09.994446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:09.995528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:09.996028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:09.997401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:09.997952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:09.999939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.006149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.sql.core [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 29 18:30:10.006149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 29 18:30:10.006149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [parameters: {'id': '05777e650a084637a1937cc738a79a04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 29 18:30:10.006149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80123) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 29 18:30:10.012401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 478/950] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:10.014006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05777e650a084637a1937cc738a79a04.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05777e650a084637a1937cc738a79a04. Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application conn.query(q) Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 18:30:10.015077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result.read() Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Apr 29 18:30:10.016283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return project_ref.to_dict() Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application next(self.gen) Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application yield resource Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application next(self.gen) Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.session.rollback() Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.force_reraise() Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise self.value Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application session.commit() Apr 29 18:30:10.017237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._prepare_impl() Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.session.flush() Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._flush(objects) Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application compat.raise_( Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application flush_context.execute() Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 29 18:30:10.018122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rec.execute(self) Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 29 18:30:10.019023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application conn.query(q) Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result.read() Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 18:30:10.019865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [parameters: {'id': '05777e650a084637a1937cc738a79a04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.020717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:10.021498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.Conflict( Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05777e650a084637a1937cc738a79a04. Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.022970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 473/951] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Apr 29 18:30:09 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:10.025536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:10.132673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ddaa-e8b2-4968-8407-655c8c4dde4c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:10.141512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf143-a48c-4056-8a2f-993124a4c2d7 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:10.169386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:10.170126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.170629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.170916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.171662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:10.171971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:10.173353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.178167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:10.178535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 479/952] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:10.179524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.180031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.180508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.184355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:10.188502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:10.190400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:10.205717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:10.206668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:10.207643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:10.209876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 474/953] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:10.215641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:10.294166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83b090-be3e-435e-949d-e95aa67e8540 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:10.325874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb70e9b-744e-45e4-b7df-7b093e59d5fe None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:10.330048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccc697-975a-49f9-9fbc-6827d89df7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:10.330818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccc697-975a-49f9-9fbc-6827d89df7c9 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.331238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccc697-975a-49f9-9fbc-6827d89df7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.331636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccc697-975a-49f9-9fbc-6827d89df7c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.332477 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccc697-975a-49f9-9fbc-6827d89df7c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:10.334077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccc697-975a-49f9-9fbc-6827d89df7c9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.362457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 480/954] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:30:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:30:10.381630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:10.383267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.383783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.384267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.385595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:10.386092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:10.387819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae3396-6034-4114-9302-dce27c56f8b6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.409590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 475/955] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:10.473911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb552d05-3975-4dde-84db-17b4d2ab796c None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.474459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb552d05-3975-4dde-84db-17b4d2ab796c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.474879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb552d05-3975-4dde-84db-17b4d2ab796c None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.476964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 481/956] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:10.483224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.483754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.484178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.507545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:10.509434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:10.592829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 476/957] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:10.614971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb552d05-3975-4dde-84db-17b4d2ab796c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:10.717839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb552d05-3975-4dde-84db-17b4d2ab796c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:10.753053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:10.754230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.754716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.755230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.756078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:10.758210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:10.770198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:10.771200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:10.772030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:10.774908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 482/958] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:10.783152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:10.879713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b04720-2940-4fd0-8c33-2a87455618d9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:10.914754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:10.915457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:10.915744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:10.916026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:10.916741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:10.917053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:10.918422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff26f-7200-4e0d-b586-6e623e10b4f0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:10.923706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 477/959] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:10.930194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:11.034721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d208619-60a0-407e-ab28-9be492670370 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:11.069092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:11.069812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:11.070097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:11.070378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:11.071123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:11.071449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:11.072887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ecd7b-e519-4011-8983-01c60dbd9a45 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:11.078730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 483/960] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:12.225045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eecbcb-26f7-4315-a08a-1f9d6a814558 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.225650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eecbcb-26f7-4315-a08a-1f9d6a814558 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.225650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eecbcb-26f7-4315-a08a-1f9d6a814558 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.227455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 478/961] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:12.232735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.233165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.233337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.250823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:12.252066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:12.326292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 484/962] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:12.343632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eecbcb-26f7-4315-a08a-1f9d6a814558 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:12.445151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eecbcb-26f7-4315-a08a-1f9d6a814558 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:12.478570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:12.479352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.479636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.479912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.490986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:12.500046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:12.501102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:12.501947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:12.506515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 479/963] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Apr 29 18:30:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:12.508087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:12.610013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6eda-190f-4bc8-a246-5dc519c1e8b0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:12.648666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:12.649343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.649730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.650067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.650831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:12.651164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:12.652558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad54172-2cad-46ca-bb1e-fc2342231e49 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:12.666850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 485/964] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:30:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:12.668268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:12.687144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1c26-1957-4e48-a775-22081ce6e81e None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.687460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1c26-1957-4e48-a775-22081ce6e81e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.687741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1c26-1957-4e48-a775-22081ce6e81e None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.689338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 486/965] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:12.694154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee58ee-ec5c-45b6-baef-883ac57704bd None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.694483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee58ee-ec5c-45b6-baef-883ac57704bd None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.694766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee58ee-ec5c-45b6-baef-883ac57704bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.711057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c7ee58ee-ec5c-45b6-baef-883ac57704bd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:12.712281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c7ee58ee-ec5c-45b6-baef-883ac57704bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:12.779142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75f5b-85f4-43ee-97b7-5093002a588c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:12.796932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 487/966] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:12.807094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd52354-5cab-4d05-b923-b22dfbb44df4 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.807412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd52354-5cab-4d05-b923-b22dfbb44df4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.807703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd52354-5cab-4d05-b923-b22dfbb44df4 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.809240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 488/967] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:12.813975 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.814189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.814443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.823986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:12.825240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:12.825534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:12.825815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:12.830445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:12.831652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:12.838603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:12.840559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:12.863440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:12.864345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:12.865256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:12.865256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:12.865256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:12.865256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:12.865777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 480/968] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:12.866759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:12.911132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 489/969] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:12.911132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:12.968956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdde4f-4048-41db-8f84-a084f9a0bb53 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.003230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6a28d-7e24-4f0c-8c78-61450cd25a0f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.003458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.004730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.005259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.005774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.006576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.008022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:13.020926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:13.022154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.023550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 481/970] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:13.024594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.045942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.046540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.046841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.047471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.048429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:13.049162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.050678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.066214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 490/971] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:13.066214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.157424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a26cd-36b9-47e1-aecc-17cbba5a6c67 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.165884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb45e8a-14d3-4c1f-bea5-f22a0c4ffbdb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.191039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.191958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.192384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.192804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.193636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.195863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.198465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.199149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.199434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.199712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.200415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:13.200721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.202075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.206825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 491/972] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:13.207670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.215410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.sql.core [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 29 18:30:13.215410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 29 18:30:13.215410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [parameters: {'user_id': 'c5c5a1e705c64007b0ec73ead975a877', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 29 18:30:13.215410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80123) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application conn.query(q) Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result.read() Apr 29 18:30:13.226361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 18:30:13.227906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application next(self.gen) Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application yield resource Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application next(self.gen) Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.session.rollback() Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.force_reraise() Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise self.value Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application session.commit() Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 29 18:30:13.228962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._prepare_impl() Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.session.flush() Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._flush(objects) Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application compat.raise_( Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application flush_context.execute() Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rec.execute(self) Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 29 18:30:13.229876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = connection._execute_20( Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 18:30:13.232351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application conn.query(q) Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application result.read() Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 18:30:13.235070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c5c5a1e705c64007b0ec73ead975a877', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:13.237077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Apr 29 18:30:13.239059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 482/973] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Apr 29 18:30:13 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:13.241348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.315472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90f36c-1070-4dae-9b27-b3a8a270a7ae None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.331669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c26c-af79-46aa-a1d6-40043fe9324e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.348984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.349802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.350088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.350366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.358104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.359605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.365629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.366335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.366611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.366888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.367643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:13.367949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.369515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:13.374244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:13.375296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:13.376323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 492/974] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:13.376947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.387897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 483/975] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:13.387897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.483222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067028a2-7801-41c7-a1e4-0a160868fd92 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.483369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30524-a21d-428c-bf4f-4997ffc63113 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.514892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.515094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.515712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.515812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.515993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.516085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.516266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.516368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.517159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:13.517467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.518900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.524905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.526341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.535999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 484/976] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:13.536806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-20e3e96a-762b-4426-8f7f-fd04411d948a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:13.540262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:13.541406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:13.542386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 493/977] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:13.542992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580468-0007-4dda-9ece-102fe52ecb77 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.543126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580468-0007-4dda-9ece-102fe52ecb77 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.543409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580468-0007-4dda-9ece-102fe52ecb77 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.544774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 494/978] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:13.545321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580468-0007-4dda-9ece-102fe52ecb77 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.635049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58d0ba-5ef1-4e45-8ad9-560a66d4fb72 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.639728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580468-0007-4dda-9ece-102fe52ecb77 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.667292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.667950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.668238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.668515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.669318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] RBAC: Adding query filter params (interface=admin, service_id=6f522b1b51794679a765ee0f46390ded, region_id=RegionOne) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:13.669636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.670329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb80a2-c2cc-4667-a1f4-4249c0bedc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.670960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb80a2-c2cc-4667-a1f4-4249c0bedc4b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.671052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.671275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb80a2-c2cc-4667-a1f4-4249c0bedc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.671555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb80a2-c2cc-4667-a1f4-4249c0bedc4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.678104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 485/979] 10.222.0.45 () {56 vars in 1249 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/endpoints?service_id=6f522b1b51794679a765ee0f46390ded&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:13.679448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.736342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb80a2-c2cc-4667-a1f4-4249c0bedc4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.737792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb80a2-c2cc-4667-a1f4-4249c0bedc4b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.778241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cbf84-d57f-43fe-9169-a6a0a739d708 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.809379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.810051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.810333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.810607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.811437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:13.811751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.813168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:13.830201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 495/980] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:13.831516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.831801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.832077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.846716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 486/981] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:13.847314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:13.847637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.848489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:13.923254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 496/982] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:13.923254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:13.958961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74175a2-d339-4045-abc7-68e8867deb83 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:13.995545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:13.996229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:13.996514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:13.996791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:13.997480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:13.998871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.005228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 487/983] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:30:14.008413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:14.031932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7eea2-27fd-4c73-accc-a5cdf6956249 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:14.084230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:14.085478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:14.085774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:14.086055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:14.101153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:14.102844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:14.123960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:14.124956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:14.125855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:14.125855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:14.125855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:14.125855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:14.128053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 497/984] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:14.134723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:14.141960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65eb41-8112-4d16-b363-57edf05d4157 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:14.184466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:14.185460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:14.185746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:14.186028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:14.186765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:14.188174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.203754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 488/985] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:14 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:14.250652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252d8e7-96ee-49df-bf2c-a6be2d4bba66 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:14.294186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:14.294857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:14.295203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:14.295431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:14.296156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:14.296460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:14.297863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.310824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 498/986] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:14.316704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:14.420331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec953a6-d4e8-4c97-95f2-318bf3274639 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:14.455219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:14.455962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:14.456242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:14.456516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:14.466235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:14.467704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:14.482194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:14.483350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:14.484285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 489/987] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:14.489376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:14.588796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e79d79-d73a-4b2d-9665-62ffa1a982f9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:14.620977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:14.621637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:14.621919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:14.622193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:14.622978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:14.623312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:14.624734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183d02-e9af-441b-8665-542ae0938d78 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.636769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 499/988] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:14.642491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:14.738489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f64415-7509-4388-8dde-e18fc226850b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:14.774769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:14.775615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:14.775993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:14.776378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:14.777601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] RBAC: Adding query filter params (role.id=0aed4e1b4d81481e81e6ba983c8ea9be, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=e399c8a0fd11423c8a70db4235228060) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:14.777978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:14.779435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5be4-31c0-4f76-a181-401008ed8ad1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:14.785888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 490/989] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:14 2022] GET /identity/v3/role_assignments?user.id=e399c8a0fd11423c8a70db4235228060&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=0aed4e1b4d81481e81e6ba983c8ea9be => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:16.325046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c905-4a84-48ec-b87b-b8b81b1196d7 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.325588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c905-4a84-48ec-b87b-b8b81b1196d7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.325588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c905-4a84-48ec-b87b-b8b81b1196d7 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.327089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 500/990] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:16.332833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafd85-a84d-462d-b30f-6f07861b318a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.333340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafd85-a84d-462d-b30f-6f07861b318a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.333429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafd85-a84d-462d-b30f-6f07861b318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.351527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-91fafd85-a84d-462d-b30f-6f07861b318a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:16.353115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-91fafd85-a84d-462d-b30f-6f07861b318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:16.420528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 491/991] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:16.445644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c905-4a84-48ec-b87b-b8b81b1196d7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:16.541486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf1f1-7952-4120-a130-ba450c7c2b2f None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.541778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf1f1-7952-4120-a130-ba450c7c2b2f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.542062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf1f1-7952-4120-a130-ba450c7c2b2f None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.543639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 492/992] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:16.546095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c905-4a84-48ec-b87b-b8b81b1196d7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:16.548331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.548621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.548903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.565453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:16.566622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:16.580678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:16.581784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.582067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.582342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.582993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:16.584392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:16.596149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:16.597302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:16.598154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 501/993] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Apr 29 18:30:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:16.603082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:16.639987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 493/994] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:16.662683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:16.714060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ca44b-6bb3-45ab-82d9-96abe8f9d677 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:16.751514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:16.752631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.752909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.753211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.753879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:16.754181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:16.755587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:16.761258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 502/995] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:16.763464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba0a6-9a40-4043-95c0-4ffab46212b9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:16.768249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:16.796341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:16.797144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.797433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.797707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.798365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:16.799769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:16.811789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:16.812976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:16.813797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 494/996] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:16.818571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:16.871356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66161847-54b5-487d-8fe6-0c42473585e6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:16.903751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:16.904422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.904706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.904984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.905907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:16.906016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:16.907378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:16.912221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 503/997] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Apr 29 18:30:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:16.918459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:16.931494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50a37e-b113-4eca-9bd7-6c74f5ab7251 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:16.969176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:16.969880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:16.970165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:16.970440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:16.971212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:16.971525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:16.972946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:16.982693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 495/998] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:16.985135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:17.033730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc36540-3452-4505-b1ac-c40eba519906 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.068219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.068876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.069187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.069465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.070207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.071621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.087359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a78da-b9c2-42c6-8e17-bc1f3a3304dc None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.088906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 504/999] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:30:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:30:17.130714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.131356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.131679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.131956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.132679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] RBAC: Adding query filter params (type=compute) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:17.132989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.134375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73336b83-94ff-4f98-87a2-aee23e3b24be None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.144929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 496/1000] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:17.146119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:17.156661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19ed1-1ca5-4f81-bc24-35cd408a9b29 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.156966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19ed1-1ca5-4f81-bc24-35cd408a9b29 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.157246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19ed1-1ca5-4f81-bc24-35cd408a9b29 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.158666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 497/1001] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:17.164979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.165271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.165550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.186160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:17.187430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:17.257431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 498/1002] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:17.262295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b5bf2-ab5c-4a4e-950d-f01351f5b69e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.280177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:17.301109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.303191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.303191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.303191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.307905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] RBAC: Adding query filter params (interface=public, service_id=aa1417b45e3d45b482c1749fc5531d06, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:17.307905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.307905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.311500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 505/1003] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:30:17 2022] GET /identity/v3/endpoints?service_id=aa1417b45e3d45b482c1749fc5531d06&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:17.316952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:17.378042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5700-fe1e-4f64-bcfb-3ec5114462d6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.412238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.412438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba23e5-2640-492a-8489-ef6415d955bd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.413545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.413796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.414071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] PATH_INFO: `/v3/services/image` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.414725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.416122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:17.427467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:17.428479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:17.434468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 499/1004] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Apr 29 18:30:17 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:17.435689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:17.445366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.446037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.446372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.446653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.447388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.448767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.454972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 506/1005] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:30:17 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:30:17.545522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090e852-5509-498d-84a8-bd6f702f2f4e None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.578774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.579491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.579775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.580051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.580771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] RBAC: Adding query filter params (name=image) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:17.581076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.582464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df77991-567e-4564-aeda-eca4a2d2a923 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.593115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 500/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:17.594315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:17.692527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06c94-603f-48a9-a565-376a72ec17d9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:17.725925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:17.726591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:17.726875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:17.727175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:17.727878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:17.728185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:17.729555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373e6a-8683-4d69-8347-cda433862ee5 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:17.743139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 507/1007] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:19.372498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c4c1-c912-427c-8d9e-01369cc9e0d1 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.373069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c4c1-c912-427c-8d9e-01369cc9e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.373069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c4c1-c912-427c-8d9e-01369cc9e0d1 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.374559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 501/1008] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:19.379580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.379996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.380189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.397887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:19.399060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:19.469178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 508/1009] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:19.492037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c4c1-c912-427c-8d9e-01369cc9e0d1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:19.595039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c4c1-c912-427c-8d9e-01369cc9e0d1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:19.627604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc1204-2681-4cd5-a6d5-939108ff3337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:19.628348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1204-2681-4cd5-a6d5-939108ff3337 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.628630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1204-2681-4cd5-a6d5-939108ff3337 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.628907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc1204-2681-4cd5-a6d5-939108ff3337 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.630083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc1204-2681-4cd5-a6d5-939108ff3337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:19.632128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc1204-2681-4cd5-a6d5-939108ff3337 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:19.633885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 502/1010] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:19.639779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:19.701840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1f35-26ec-4212-babb-7e032710801a None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.702164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1f35-26ec-4212-babb-7e032710801a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.702402 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1f35-26ec-4212-babb-7e032710801a None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.703919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 503/1011] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:19.708874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.709259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.709626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.726811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:19.728169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:19.736596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540a29c-87c5-41f6-a917-48c26f670192 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:19.769703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526a164-8bbc-4c3f-8a40-cc8c015a9775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:19.770357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a164-8bbc-4c3f-8a40-cc8c015a9775 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.770641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a164-8bbc-4c3f-8a40-cc8c015a9775 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.770919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a164-8bbc-4c3f-8a40-cc8c015a9775 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.771671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526a164-8bbc-4c3f-8a40-cc8c015a9775 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:19.773140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526a164-8bbc-4c3f-8a40-cc8c015a9775 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:19.811352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 504/1012] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:19.822028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 509/1013] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:19 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:30:19.837729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:19.952928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed00e2b-fa3e-4161-b3bd-27e1a9459f01 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:19.993159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:19.994259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d248f3-01f0-42f5-b686-3009f5d6034b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.994554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d248f3-01f0-42f5-b686-3009f5d6034b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.994824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:19.994929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d248f3-01f0-42f5-b686-3009f5d6034b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.995421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:19.995887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:19.996751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:19.998332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:20.001644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 510/1014] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:20.003087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:20.003403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:20.003682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:20.012823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:20.013916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 18:30:20.014764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:20.017735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 505/1015] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:20.023988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:20.030206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:20.032565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:20.135143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 511/1016] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:20.146285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a9e5-f981-4531-89c8-102ab9db5f6a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:20.155328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:20.191694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:20.192694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:20.192998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:20.193519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:20.194287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:20.194773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:20.196749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:20.208066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 506/1017] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:20.210033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:20.289566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df36eb-aefc-4f00-9b9f-7126135b0eb1 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:20.329286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed8018-c83d-4e25-8278-4f249f711260 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:20.330327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:20.331183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:20.332253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:20.332548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:20.333324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:20.335254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:20.360393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 512/1018] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:20 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:20.380129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:20.380853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:20.381377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:20.381889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:20.382924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:20.383524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:20.385526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0149e-ceb4-45ed-a5fb-11db566e0776 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:20.392262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 507/1019] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Apr 29 18:30:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:20.400289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:20.519042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a53d80-7907-4a3d-8fc9-727e33af8d87 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:20.559619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c37045-5f0d-4fd9-9646-a417799b8864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:20.560293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37045-5f0d-4fd9-9646-a417799b8864 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:20.560580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37045-5f0d-4fd9-9646-a417799b8864 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:20.560861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37045-5f0d-4fd9-9646-a417799b8864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:20.561596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c37045-5f0d-4fd9-9646-a417799b8864 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:20.562970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c37045-5f0d-4fd9-9646-a417799b8864 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:20.586994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 513/1020] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:30:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:22.183869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1714b-0420-44b4-ba12-c3c11b97312f None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:22.184415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1714b-0420-44b4-ba12-c3c11b97312f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:22.184415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1714b-0420-44b4-ba12-c3c11b97312f None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:22.185948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 508/1021] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:22.190991 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:22.191407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:22.191583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:22.208440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:22.210156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:22.281991 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 514/1022] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:22.305989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1714b-0420-44b4-ba12-c3c11b97312f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:22.405044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1714b-0420-44b4-ba12-c3c11b97312f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:22.440598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7420cf1-2b21-4385-910b-70820fa40854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:22.441329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7420cf1-2b21-4385-910b-70820fa40854 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:22.441609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7420cf1-2b21-4385-910b-70820fa40854 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:22.441882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7420cf1-2b21-4385-910b-70820fa40854 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:22.443057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7420cf1-2b21-4385-910b-70820fa40854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:22.444578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7420cf1-2b21-4385-910b-70820fa40854 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:22.446406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 509/1023] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:22.453988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:22.548608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c085267-3e34-4321-83f6-837ca33565cf None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:22.588232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb51d1-76db-4a4a-a523-285937eaa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:22.589274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb51d1-76db-4a4a-a523-285937eaa15f None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:22.589757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb51d1-76db-4a4a-a523-285937eaa15f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:22.590228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb51d1-76db-4a4a-a523-285937eaa15f None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:22.591199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb51d1-76db-4a4a-a523-285937eaa15f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:22.592861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb51d1-76db-4a4a-a523-285937eaa15f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:22.622637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 515/1024] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:30:22 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:30:22.754520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686616-7440-46a1-979c-606bd5bacd28 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:22.754823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686616-7440-46a1-979c-606bd5bacd28 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:22.755004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686616-7440-46a1-979c-606bd5bacd28 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:22.757124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 510/1025] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:22.762695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:22.762993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:22.763303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:22.780499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:22.781695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:22.857275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 516/1026] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:22.880119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686616-7440-46a1-979c-606bd5bacd28 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:22.986545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686616-7440-46a1-979c-606bd5bacd28 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.020397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.021124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.021402 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.021675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] PATH_INFO: `/v3/services/image` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.022365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.023810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ca8b83f1-a1d0-4173-8dc0-7fc74190568e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:23.035123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:23.036115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:23.036957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 511/1027] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Apr 29 18:30:22 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:23.042962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.138855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95968-e870-4076-bc08-15350268dcbe None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.151435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f63d1-e330-4192-816d-c167b192143f None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.151723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f63d1-e330-4192-816d-c167b192143f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.152003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f63d1-e330-4192-816d-c167b192143f None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.153500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 512/1028] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:23.158074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.158363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.158637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.174686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.174879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:23.175380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.175663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.175941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.176037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:23.176640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] RBAC: Adding query filter params (name=image) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:23.176945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.178333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.187563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 517/1029] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:23.188412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.244623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 513/1030] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:23.268814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.285256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eaf40-a834-4be7-a4d2-5a03d7bfaaad None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.318550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.319779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.320057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.320328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.321025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] RBAC: Adding query filter params (type=image) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:23.321327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.322700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.331151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 518/1031] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:23.333200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.370553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7ba4-0212-43dd-8990-c5db99b8ffbc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.404059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.404871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.405152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.405422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.415132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:23.423200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:23.424140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:23.430368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 514/1032] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:23.431080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3252cc-c000-4aba-a9ca-8da0abfb641d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.432562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.465502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.466503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.466990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.467505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.468473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] RBAC: Adding query filter params (interface=public, service_id=11a71e0ed545464e8e4375c841ce18c4, region_id=RegionOne) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:23.468967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.470544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.476070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 519/1033] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/endpoints?service_id=11a71e0ed545464e8e4375c841ce18c4&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:23.481264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.533639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b115-4ffa-4f70-a101-4b8b45f27122 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.567892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.568495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.568777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.569599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.570346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:23.570653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.572048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.580269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13b3f0-d26c-4982-81b6-9b7d08d1ae05 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.584893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 515/1034] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:23.585629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.612864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.613523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.613805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.614077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.614752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.616675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.622945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 520/1035] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:30:23.689717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace7ed-d29f-42a6-9376-7ec8c248dbf3 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.723873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.724690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.724974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.725761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.737241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.738719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:23.757753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:23.758800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:23.765076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:23.765076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:23.765076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:23.765076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:23.765076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 516/1036] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:23.766908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:23.871972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd014bc3-e1d2-4467-8582-9c2629c54b95 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:23.904443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:23.905108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:23.905390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:23.905667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:23.906385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:23.906689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:23.908118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:23.919547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 521/1037] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:23.925259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:24.023443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccdc66-69df-429b-be5e-92ae2e473af7 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:24.055436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:24.056234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.056518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.056791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.064164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:24.065600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:24.079162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:24.080098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:24.081039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 517/1038] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:30:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:24.088381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:24.186791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2539-34ff-41f7-884f-14bdd8b416f3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:24.219397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:24.220069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.220348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.220621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.221452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:24.221758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:24.223224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:24.245127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 522/1039] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:30:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:24.247219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:24.345194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d631a-d6fe-494c-86ac-7c8e18bf3552 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:24.377003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:24.377661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.377944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.378219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.450246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:24.451655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:24.553793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 518/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:24.555283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:24.651540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9302-6432-4fd2-ad7c-5da330e72523 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:24.683744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:24.684540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.684819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.685090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.695255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:24.696744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:24.714388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:24.715514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:24.716423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:24.716423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:24.716423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:24.716423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:24.716423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 523/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:24.722299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:24.824005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a723-c577-4aea-92fa-b165e28af058 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:24.858295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:24.858967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.859284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.859564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.860281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:24.860586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:24.861952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f09ff-5524-4e7e-b344-46cbf04a3679 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:24.873563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 519/1042] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:24.878901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:24.961084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf984-e02e-4fcc-82a2-cc9d447d9bf8 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.961441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf984-e02e-4fcc-82a2-cc9d447d9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.961650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf984-e02e-4fcc-82a2-cc9d447d9bf8 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.963034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 520/1043] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:24.967955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:24.968193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:24.968481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:24.977122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824f2b-3654-4f7e-a238-7e5634183822 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:24.985315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:24.986509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:25.011684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.012468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.012759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.013037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.019630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:25.021077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:25.034463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:25.035423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:25.036359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 524/1044] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:25.041318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.057790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 521/1045] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:25.081198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.140721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b959-d2d8-4500-9a8c-34a88b0256dd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:25.176863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.177521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.177801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.178072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.179390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5e48-5f70-4ae4-99d8-77ab2e55949b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:25.179497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:25.179755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:25.181184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:25.193533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 525/1046] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:25.199144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.218737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.219515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.219802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.220082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.230774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:25.238396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:25.240896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:25.242522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 522/1047] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:25.246391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.301625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dc18b-3460-4d39-b338-90a6ad57d632 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:25.334874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.335569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.335877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.336138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.336978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] RBAC: Adding query filter params (role.id=0aed4e1b4d81481e81e6ba983c8ea9be, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=9c539d6a3d1d49bcaadcea8970560c39) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:25.337293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:25.338729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:25.342026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d0f2e-c78d-458e-836b-4ab78c60874f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:25.344408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 526/1048] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/role_assignments?user.id=9c539d6a3d1d49bcaadcea8970560c39&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=0aed4e1b4d81481e81e6ba983c8ea9be => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:25.388883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.389617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.389903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.390182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.390951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:25.391302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:25.392714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:25.407419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 523/1049] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:25.409910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.519559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e54372-61b0-4f3a-a2a6-720eeb930852 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:25.552723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.554153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.554439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.554719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] PATH_INFO: `/v3/users/70ab6e95e1b744eda6f9e40ed5cab47b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.567514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] RBAC: Authorizing `identity:get_user(user_id=70ab6e95e1b744eda6f9e40ed5cab47b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:25.568996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:25.575280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 527/1050] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/users/70ab6e95e1b744eda6f9e40ed5cab47b => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:25.576873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.674288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09663a9-295a-40af-ab64-6fc2b12b61a5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:25.712559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65257947-7268-4099-b869-63c80d1dbaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:25.713244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65257947-7268-4099-b869-63c80d1dbaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.713528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65257947-7268-4099-b869-63c80d1dbaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.713805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65257947-7268-4099-b869-63c80d1dbaf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.780000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65257947-7268-4099-b869-63c80d1dbaf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:25.781375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65257947-7268-4099-b869-63c80d1dbaf0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:25.885610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 524/1051] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:25.887274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:25.890277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8733-db39-4f18-95e2-384878ffb769 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.890572 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8733-db39-4f18-95e2-384878ffb769 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.891712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da8733-db39-4f18-95e2-384878ffb769 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.892348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 525/1052] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:25.897451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:25.897745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:25.898026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:25.916431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:25.917610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:25.982164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 526/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:25.993916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfbe8d-be41-4caa-9d51-fe73f4440b69 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:26.005029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:26.031810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:26.032589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:26.032868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:26.033140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:26.034307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8124b0df64044c7081c45bcfcde66bb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:26.035791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:26.037657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 528/1054] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:25 2022] GET /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:26.043488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:26.104676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53740b5e-74ff-4843-86d4-132091b51090 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:26.142433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:26.143268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:26.143552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:26.143833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:26.144471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:26.145929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:26.149134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfda86-2e16-4748-b728-a13d53df21a6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:26.159163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:26.160279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:26.161130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 527/1055] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Apr 29 18:30:26 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:26.166295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:26.185440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:26.186102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:26.186382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:26.186656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:26.187515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=8124b0df64044c7081c45bcfcde66bb2, user.id=70ab6e95e1b744eda6f9e40ed5cab47b) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:26.187823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:26.189250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:26.195348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 529/1056] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:26 2022] GET /identity/v3/role_assignments?user.id=70ab6e95e1b744eda6f9e40ed5cab47b&scope.project.id=8124b0df64044c7081c45bcfcde66bb2&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:26.275903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3791-2fcc-434d-815c-81bbf78f0f8b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:26.311558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:26.312543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:26.313039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:26.313502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:26.314406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] RBAC: Adding query filter params (name=image) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:26.314901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:26.316506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:26.327498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 528/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:26.329054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:26.431344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f950-d518-40a6-94b3-fcebe78609b6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:26.475745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:26.476438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:26.476719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:26.476998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:26.477726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] RBAC: Adding query filter params (type=image) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:26.478036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:26.479505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422bf85-b31d-4b59-81f8-03663c44d094 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:26.489889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 530/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:26.491814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:26.590244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3472-05c3-4f96-ba0b-11c5a505fb94 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:26.622897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e8340-df7d-45a2-9bde-9b8271279b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:26.623811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8340-df7d-45a2-9bde-9b8271279b7e None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:26.624264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8340-df7d-45a2-9bde-9b8271279b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:26.624692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8340-df7d-45a2-9bde-9b8271279b7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:26.625579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e8340-df7d-45a2-9bde-9b8271279b7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:26.627126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e8340-df7d-45a2-9bde-9b8271279b7e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:26.649239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 529/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:30:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:27.610546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd737b6-eff3-4575-b010-20cc8f15dfcc None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:27.611056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd737b6-eff3-4575-b010-20cc8f15dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:27.611056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd737b6-eff3-4575-b010-20cc8f15dfcc None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:27.612458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 531/1060] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:27.617868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:27.618700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:27.619214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:27.636351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:27.637521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:27.707600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 530/1061] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:27.730006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd737b6-eff3-4575-b010-20cc8f15dfcc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:27.829682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd737b6-eff3-4575-b010-20cc8f15dfcc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:27.861325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:27.862139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:27.862418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:27.862686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:27.872807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:27.880799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:27.882411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:27.883720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:27.887779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 532/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Apr 29 18:30:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:27.888778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:27.984381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af273a9-1a77-40cb-b6c3-4b0cb394b7b9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.017387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.018061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.018341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.018614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.019386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:28.019691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.021048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.028944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 531/1063] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:30:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:28.034352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.130074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7757c-9604-48a6-bfdb-7f0a85042f6a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.164189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.164990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.165272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.165548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.175887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.177336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:28.194426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:28.195581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:28.201092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:28.201092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:28.201092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:28.201092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:28.201092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 533/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:28.201366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.304361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fff74-58f2-4f97-b224-ca3ed8095823 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.336608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.337630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.338111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.338582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.339564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:28.340070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.341612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf065-bc82-4b23-bf17-64c1f846b89a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.353830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 532/1065] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:28.359590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.437815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2a36-a01a-4941-afd0-4be1c67b8ffa None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.438132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2a36-a01a-4941-afd0-4be1c67b8ffa None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.439507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2a36-a01a-4941-afd0-4be1c67b8ffa None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.440666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 533/1066] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:28.445649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.445869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.446114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.462085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6536b-270f-4865-b718-35f0eb303a41 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.462288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:28.463356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:28.495789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.496589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.496909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.497145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.504984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.506457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:28.520788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:28.521787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 534/1067] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:28.527768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.532400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 534/1068] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:28.555740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.631365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d20d58-1f15-4cd5-a138-16ea5726a20d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.652803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a410-e9eb-496e-81ec-588ef6af7472 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.665093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.665769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.666034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.666303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.667156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:28.667467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.668890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.687038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.687873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.688157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.688439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.690344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 535/1069] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:28.691257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.699696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:28.707424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:28.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:28.711847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 535/1070] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:28.715230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.792844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013b20a-291e-4068-9ab4-b48f03fd522a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.823541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4aeb-9225-4a58-a0f1-5fe49bed92cd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.831816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.832894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.833366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.833841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.844621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.846189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.857567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:28.858243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:28.858527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:28.858803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:28.859609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:28.859896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:28.861256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:28.864218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:28.865130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:28.866082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:28.866082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:28.866082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:28.866082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:28.867261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 536/1071] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:28.870262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 536/1072] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:28.871165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.875925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:28.972899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b713b-f20d-4019-958b-aba669e73c6a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:28.975635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83ca9-31e1-4d9d-9adf-87c7943e0094 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.004010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.004668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.004950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.005227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.005941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:29.006763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.007380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9eb4-9b3d-4b31-9e2d-d252ca6b59d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.008158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694ca2f-0dd8-4364-aa79-69ffcb5ae86f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.008273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9eb4-9b3d-4b31-9e2d-d252ca6b59d4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.008518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9eb4-9b3d-4b31-9e2d-d252ca6b59d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.008791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9eb4-9b3d-4b31-9e2d-d252ca6b59d4 None admin] PATH_INFO: `/v3/users/70ab6e95e1b744eda6f9e40ed5cab47b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.009979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9eb4-9b3d-4b31-9e2d-d252ca6b59d4 None admin] RBAC: Authorizing `identity:get_user(user_id=70ab6e95e1b744eda6f9e40ed5cab47b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.011687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9eb4-9b3d-4b31-9e2d-d252ca6b59d4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.013309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 537/1073] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/users/70ab6e95e1b744eda6f9e40ed5cab47b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:29.014539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eef46-6b07-45ca-8e5e-85474545a4c4 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.014835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eef46-6b07-45ca-8e5e-85474545a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.015142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eef46-6b07-45ca-8e5e-85474545a4c4 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.016503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 538/1074] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:29.018835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eef46-6b07-45ca-8e5e-85474545a4c4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.025313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 537/1075] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:29.026313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91975406-af52-4c98-9493-7441811a1300 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.026597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91975406-af52-4c98-9493-7441811a1300 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.026873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91975406-af52-4c98-9493-7441811a1300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.042299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-91975406-af52-4c98-9493-7441811a1300 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:29.043494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-91975406-af52-4c98-9493-7441811a1300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:29.104138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 538/1076] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:29.104938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91975406-af52-4c98-9493-7441811a1300 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.114644 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eef46-6b07-45ca-8e5e-85474545a4c4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.151201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.152686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.153160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.153601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.155181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] RBAC: Authorizing `identity:get_project(project_id=8124b0df64044c7081c45bcfcde66bb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.156681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.158424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 539/1077] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:29 2022] GET /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:29.159219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.214712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91975406-af52-4c98-9493-7441811a1300 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.246476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.247305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.247593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.247872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.254259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.255747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.257261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946add0-403b-4a66-ac9e-0a10cf95dac6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:29.269847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:29.270920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 539/1078] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:29.271935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.293411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.294067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.294351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.294629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.361600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.362986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.368868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a665d0-895e-43ac-b8ef-2cbc43ddde25 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.401026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.401906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.402186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.402540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2/users/70ab6e95e1b744eda6f9e40ed5cab47b/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.404464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] RBAC: Authorizing `identity:create_grant(project_id=8124b0df64044c7081c45bcfcde66bb2, user_id=70ab6e95e1b744eda6f9e40ed5cab47b, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.405890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.418388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 540/1079] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:30:29 2022] PUT /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2/users/70ab6e95e1b744eda6f9e40ed5cab47b/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:30:29.419206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.477035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 540/1080] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:29.478255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.528856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bba36-9689-4b78-a69f-7e8787ce1774 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.565234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.565938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.566226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.566510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.567332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:29.567648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.569751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.581989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab63a-011b-46df-9628-49a6a29288af None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.588040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 541/1081] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:29.589219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.620551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.621372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.621654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.621927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.632615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.634083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:29.653025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:29.654519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:29.655448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:29.655448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:29.655448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:29.655448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:29.655448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 541/1082] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:29.660077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:29.691218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e1e1-9eb4-40b7-9b23-6c1f8393268d None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.724560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acded2-30ec-408d-9eec-854152885edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.726294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acded2-30ec-408d-9eec-854152885edc None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.726816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acded2-30ec-408d-9eec-854152885edc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.727215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acded2-30ec-408d-9eec-854152885edc None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/9c539d6a3d1d49bcaadcea8970560c39/roles/0aed4e1b4d81481e81e6ba983c8ea9be` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.729447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acded2-30ec-408d-9eec-854152885edc None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=9c539d6a3d1d49bcaadcea8970560c39, role_id=0aed4e1b4d81481e81e6ba983c8ea9be)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.730935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acded2-30ec-408d-9eec-854152885edc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.746722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 542/1083] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:30:29 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/9c539d6a3d1d49bcaadcea8970560c39/roles/0aed4e1b4d81481e81e6ba983c8ea9be => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:30:29.760989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ba0c-f68a-435b-b2a3-8a1a70a1860c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:29.797443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:29.798121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:29.798403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:29.798679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:29.799449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:29.799755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:29.801136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f5845-445e-46fc-b9ca-f6a441a2a1fa None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:29.814391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 542/1084] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:31.698378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43157-b82d-4286-82f3-bd9d88933a62 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:31.698895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43157-b82d-4286-82f3-bd9d88933a62 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:31.699018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43157-b82d-4286-82f3-bd9d88933a62 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:31.700325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 543/1085] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:31.705488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:31.705872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:31.706053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:31.723074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:31.724213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:31.792380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 543/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:31.816258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43157-b82d-4286-82f3-bd9d88933a62 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:31.918291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43157-b82d-4286-82f3-bd9d88933a62 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:31.954743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11041b-3f91-432f-851c-67122afe0ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:31.955558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11041b-3f91-432f-851c-67122afe0ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:31.955842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11041b-3f91-432f-851c-67122afe0ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:31.956116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11041b-3f91-432f-851c-67122afe0ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:31.966217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11041b-3f91-432f-851c-67122afe0ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-ad11041b-3f91-432f-851c-67122afe0ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:31.973796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:31.974872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:31.975863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 544/1087] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:31.981006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.005151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d01d-aa4b-4407-8682-f9c3c5e3396a None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.005437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d01d-aa4b-4407-8682-f9c3c5e3396a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.005721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d01d-aa4b-4407-8682-f9c3c5e3396a None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.007629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 545/1088] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:30:32.012751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.013040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.013318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.029917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:32.031089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:32.076880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc303859-9a26-42ec-b35c-d51045d4e2d0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.103276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 546/1089] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:32.110901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.111617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.111903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.112180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.112928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:32.113234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.114595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.121246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.122599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 544/1090] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:32.128279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.214432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3f538-56f5-4b69-91eb-d302a8668c41 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.222048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba1ec9-50d6-4a1a-a1e4-e6d783b19abd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.246333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.247079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.247393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.247666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.253257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.254124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.254405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.254677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] PATH_INFO: `/v3/users/70ab6e95e1b744eda6f9e40ed5cab47b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.255894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] RBAC: Authorizing `identity:get_user(user_id=70ab6e95e1b744eda6f9e40ed5cab47b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.257857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.257958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:32.259526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 545/1091] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/users/70ab6e95e1b744eda6f9e40ed5cab47b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:32.265381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:32.266162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:32.267308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:32.268190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 547/1092] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:32.273610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.364966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103d322-962e-4b38-8264-9b45199b2aea None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.365237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208f10b-93ef-4012-a331-fc0cfbe69a98 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.399269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.399921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.400203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.400480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.403490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.404535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.404930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.405251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.406112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:32.406460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.408028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.416425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 548/1093] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:32.421661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.467198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.468671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.516973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7cf32-53e2-4908-8359-c93389dfa123 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.548098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.548891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.549169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.549441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.559879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.561321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.562940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 546/1094] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 29 18:30:32.569283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:32.578067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:32.578935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:32.579988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:32.579988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:32.579988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:32.579988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:32.583394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 549/1095] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:32.584646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.659803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8633ab-fec4-4e98-bc70-90b76bdbe675 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.679685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f67b8-ed49-483b-ab08-f2949cb23f62 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.691651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.692504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.692782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.693054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.694210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] RBAC: Authorizing `identity:get_project(project_id=8124b0df64044c7081c45bcfcde66bb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.695660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.697367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 547/1096] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:32.703202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.710707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.711401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.711684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.711961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.712677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:32.712982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.714342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.726082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 550/1097] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:32.731526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.794799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8a1fd-1319-4515-bd44-707c860f220a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.823701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed774-dc86-418a-940b-788ea3497893 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:32.826334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.826986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.827315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.827596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.828429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=8124b0df64044c7081c45bcfcde66bb2, user.id=70ab6e95e1b744eda6f9e40ed5cab47b) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:32.828743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.830161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.835815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 548/1098] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/role_assignments?user.id=70ab6e95e1b744eda6f9e40ed5cab47b&scope.project.id=8124b0df64044c7081c45bcfcde66bb2&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:32.858317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:32.859160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:32.859448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:32.859724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:32.868435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:32.869927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:30:32.885727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:32.886778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:32.887941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 551/1099] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:30:32.893062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:32.995235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885e11-2035-4919-a4dd-31e6cf42c69f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:33.028790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:33.029470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:33.029763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:33.030037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:33.030888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:33.031229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:33.032659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:33.049829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 549/1100] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Apr 29 18:30:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:33.056014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:33.150202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096d1f7-19df-4acd-b3cf-d93486a26703 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:33.182220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:33.182865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:33.183166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:33.183442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:33.245959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:33.247448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:33.340272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 552/1101] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:33.345838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:33.440730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925f83-88e8-414c-9fa8-d13ee0ce6803 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:33.474420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:33.475245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:33.475530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:33.475810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:33.485702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:33.487207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:30:33.504387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:33.505461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:33.511803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:30:33.511803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:30:33.511803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:30:33.511803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:33.511803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 550/1102] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:33.512113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:33.610090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0abe6-7b0e-4b8b-8924-9dac4145e443 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:33.642750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:33.643438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:33.643733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:33.644012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:33.644731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:33.645038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:33.646414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:33.657853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 553/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:33.663683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:33.758304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223d271-d4f1-4763-bc05-a418b28b1143 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:33.790298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:33.791131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:33.791419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:33.791691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:33.798038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:33.799493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:30:33.813382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:33.814527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:30:33.815749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:33.819479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 551/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:30:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:33.821077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:33.914854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de35e-7c43-4e7d-a470-6c64bc580b7b None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:33.947218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:33.948239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:33.948525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:33.948800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:33.949584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:33.949891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:33.951344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e122522-1497-4103-97b7-276ebf15eca6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:33.962774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 554/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:33.968768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:34.065974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e335-8397-435b-a6f4-5dcd48b9468b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:34.097425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:34.098082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:34.098369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:34.098647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:34.099513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] RBAC: Adding query filter params (role.id=0aed4e1b4d81481e81e6ba983c8ea9be, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=9c539d6a3d1d49bcaadcea8970560c39) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:34.099854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:34.101288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8010e-33e2-459c-a6ea-f9d1b3713cb5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:34.106916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 552/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:33 2022] GET /identity/v3/role_assignments?user.id=9c539d6a3d1d49bcaadcea8970560c39&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=0aed4e1b4d81481e81e6ba983c8ea9be => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:35.110126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c346-92d5-44f2-b47d-012912a03197 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:35.110662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c346-92d5-44f2-b47d-012912a03197 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:35.110662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c346-92d5-44f2-b47d-012912a03197 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:35.112053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 555/1107] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:35.117108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:35.117498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:35.117673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:35.134339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:35.135817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:35.197773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 553/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:35.222906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c346-92d5-44f2-b47d-012912a03197 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:35.317393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c346-92d5-44f2-b47d-012912a03197 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:35.349603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94dec1-6d4d-4479-af38-49042e652f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:35.350376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94dec1-6d4d-4479-af38-49042e652f68 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:35.350656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94dec1-6d4d-4479-af38-49042e652f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:35.350928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94dec1-6d4d-4479-af38-49042e652f68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:35.352168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94dec1-6d4d-4479-af38-49042e652f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:35.353592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94dec1-6d4d-4479-af38-49042e652f68 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:35.355192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 556/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:35.360967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:35.455311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eba82-9fbb-4c0d-b0d4-fd26f67fe1ad None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:35.487312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535129e-2df2-4805-b65d-a6079e4ecc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:35.487982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535129e-2df2-4805-b65d-a6079e4ecc3c None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:35.488265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535129e-2df2-4805-b65d-a6079e4ecc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:35.488540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535129e-2df2-4805-b65d-a6079e4ecc3c None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:35.489238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535129e-2df2-4805-b65d-a6079e4ecc3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:35.491163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535129e-2df2-4805-b65d-a6079e4ecc3c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:35.511796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 554/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:30:35 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:37.788125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c13af-8743-49ad-a41e-29611df19318 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:37.788619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c13af-8743-49ad-a41e-29611df19318 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:37.788619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c13af-8743-49ad-a41e-29611df19318 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:37.789962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 557/1111] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:37.795231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:37.795665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:37.795798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:37.813068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:37.814235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:37.878822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 555/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:37.903293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c13af-8743-49ad-a41e-29611df19318 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:38.004525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c13af-8743-49ad-a41e-29611df19318 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:38.037969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:38.038854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:38.039097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:38.039494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] PATH_INFO: `/v3/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:38.040953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] RBAC: Authorizing `identity:get_role(role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:38.042315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:38.043709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 558/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:37 2022] GET /identity/v3/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:38.049535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:38.148339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b183b-9008-4583-9ecd-40df684e4aed None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:38.181899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:38.182778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:38.183061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:38.183373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] PATH_INFO: `/v3/users/ed17eeb1cc9a4844aefa6f1f4c46ae77` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:38.196256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] RBAC: Authorizing `identity:get_user(user_id=ed17eeb1cc9a4844aefa6f1f4c46ae77)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:38.197691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:38.203160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 556/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:38 2022] GET /identity/v3/users/ed17eeb1cc9a4844aefa6f1f4c46ae77 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:38.205220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:38.301166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed428d-66d8-40ab-acaa-1672f30467d8 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:38.338893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:38.339711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:38.339909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:38.340129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:38.407496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:38.408952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:38.505408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 559/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 29 18:30:38.511659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:38.608250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d0819-9102-4f3f-b73a-ba38b939f4fa None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:38.641351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5c0fc-6c52-457f-9670-2e48fe5c206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:38.642228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5c0fc-6c52-457f-9670-2e48fe5c206f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:38.642509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5c0fc-6c52-457f-9670-2e48fe5c206f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:38.642805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5c0fc-6c52-457f-9670-2e48fe5c206f None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:38.643983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5c0fc-6c52-457f-9670-2e48fe5c206f None admin] RBAC: Authorizing `identity:get_project(project_id=8124b0df64044c7081c45bcfcde66bb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:38.645414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5c0fc-6c52-457f-9670-2e48fe5c206f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:38.647784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 557/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:38 2022] GET /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:38.654118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:38.751371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc5752-3492-4448-91b9-5b9efd2605cd None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:38.784902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:38.785555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:38.785840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:38.786136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:38.786938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] RBAC: Adding query filter params (role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=8124b0df64044c7081c45bcfcde66bb2, user.id=ed17eeb1cc9a4844aefa6f1f4c46ae77) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:38.787297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:38.788726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae05174-6084-4570-bedf-a6d79cf18c08 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:38.794179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 560/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:38 2022] GET /identity/v3/role_assignments?user.id=ed17eeb1cc9a4844aefa6f1f4c46ae77&scope.project.id=8124b0df64044c7081c45bcfcde66bb2&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:41.024561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716fe61-79bb-4c5e-869c-4d17a6cd8f46 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:41.025096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716fe61-79bb-4c5e-869c-4d17a6cd8f46 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:41.025096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716fe61-79bb-4c5e-869c-4d17a6cd8f46 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:41.026484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 558/1118] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:41.031912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:41.032341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:41.032448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:41.049638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:41.050810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:41.118166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 561/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:30:41.141234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716fe61-79bb-4c5e-869c-4d17a6cd8f46 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:41.240839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716fe61-79bb-4c5e-869c-4d17a6cd8f46 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:41.273277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:41.274133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:41.274414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:41.274726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] PATH_INFO: `/v3/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:41.276171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] RBAC: Authorizing `identity:get_role(role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:41.277574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:41.278945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 559/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:41 2022] GET /identity/v3/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:41.284899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:41.384105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b038c94-d5d0-404c-a086-7dd1294821e3 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:41.418531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:41.419459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:41.419750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:41.420024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] PATH_INFO: `/v3/users/ed17eeb1cc9a4844aefa6f1f4c46ae77` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:41.421222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=ed17eeb1cc9a4844aefa6f1f4c46ae77)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:41.422658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:41.424327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 562/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:41 2022] GET /identity/v3/users/ed17eeb1cc9a4844aefa6f1f4c46ae77 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:41.430271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:41.530288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0734-060c-4ab6-b801-48118e76aa5f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:41.563684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26977-8f8f-42ae-b2ba-146a3d744fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:41.564564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26977-8f8f-42ae-b2ba-146a3d744fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:41.564843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26977-8f8f-42ae-b2ba-146a3d744fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:41.565124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26977-8f8f-42ae-b2ba-146a3d744fb9 None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:41.566311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26977-8f8f-42ae-b2ba-146a3d744fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=8124b0df64044c7081c45bcfcde66bb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:41.567818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26977-8f8f-42ae-b2ba-146a3d744fb9 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:41.569537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 560/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:41 2022] GET /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:41.575638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:41.673390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c94dd2-0dcd-4308-85b8-dc5735b3f3a6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:41.706181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b825c46-528e-4a8c-a497-80bc10532cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:41.707077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b825c46-528e-4a8c-a497-80bc10532cbe None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:41.707394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b825c46-528e-4a8c-a497-80bc10532cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:41.707672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b825c46-528e-4a8c-a497-80bc10532cbe None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2/users/ed17eeb1cc9a4844aefa6f1f4c46ae77/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:41.710402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b825c46-528e-4a8c-a497-80bc10532cbe None admin] RBAC: Authorizing `identity:create_grant(project_id=8124b0df64044c7081c45bcfcde66bb2, user_id=ed17eeb1cc9a4844aefa6f1f4c46ae77, role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:41.711875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b825c46-528e-4a8c-a497-80bc10532cbe None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:41.725594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 563/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:30:41 2022] PUT /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2/users/ed17eeb1cc9a4844aefa6f1f4c46ae77/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:30:43.939232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367f81-bad6-4a51-80fa-1b3acd3c118f None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:43.939787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367f81-bad6-4a51-80fa-1b3acd3c118f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:43.939787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367f81-bad6-4a51-80fa-1b3acd3c118f None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:43.941131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 561/1124] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:43.946247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:43.946722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:43.946817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:43.963422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:43.964580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:44.026150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 564/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:44.049099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02367f81-bad6-4a51-80fa-1b3acd3c118f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:44.146047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02367f81-bad6-4a51-80fa-1b3acd3c118f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:44.184128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:44.184989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:44.185273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:44.185542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] PATH_INFO: `/v3/roles/bed8d7b5b8904606bcb0de011ef54ecd` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:44.187039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] RBAC: Authorizing `identity:get_role(role_id=bed8d7b5b8904606bcb0de011ef54ecd)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:44.188486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:44.189937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 562/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:44 2022] GET /identity/v3/roles/bed8d7b5b8904606bcb0de011ef54ecd => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:44.195765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:44.291883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafb871-ded6-4a9f-820d-5a59252b9e3e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:44.324099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:44.324974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:44.325253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:44.325524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] PATH_INFO: `/v3/users/ed17eeb1cc9a4844aefa6f1f4c46ae77` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:44.326707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed17eeb1cc9a4844aefa6f1f4c46ae77)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:44.328172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:44.329779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 565/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:44 2022] GET /identity/v3/users/ed17eeb1cc9a4844aefa6f1f4c46ae77 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:44.336200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:44.429907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997e45-6953-43bd-8d11-557c91e9bddd None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:44.462176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:44.462759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:44.463037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:44.463331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:44.525602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:44.527068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:44.619270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 563/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:44.625160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:44.717298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d766-4011-4abf-99e8-05c732827ce7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:44.747914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26308a9e-9c41-4565-b451-d43b2e82b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:44.748748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308a9e-9c41-4565-b451-d43b2e82b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:44.749037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308a9e-9c41-4565-b451-d43b2e82b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:44.749311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308a9e-9c41-4565-b451-d43b2e82b6f8 None admin] PATH_INFO: `/v3/projects/8124b0df64044c7081c45bcfcde66bb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:44.750463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26308a9e-9c41-4565-b451-d43b2e82b6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=8124b0df64044c7081c45bcfcde66bb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:44.751921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26308a9e-9c41-4565-b451-d43b2e82b6f8 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:44.753567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 566/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:44 2022] GET /identity/v3/projects/8124b0df64044c7081c45bcfcde66bb2 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:44.759888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:44.851399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eef400-d697-4573-ab75-78fdbc67666b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:44.882807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:44.883484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:44.883766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:44.884039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:44.884859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] RBAC: Adding query filter params (role.id=bed8d7b5b8904606bcb0de011ef54ecd, scope.project.id=8124b0df64044c7081c45bcfcde66bb2, user.id=ed17eeb1cc9a4844aefa6f1f4c46ae77) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:44.885169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:44.886838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e99970-2253-45b3-a28e-a64c2691953b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:44.892337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 564/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:44 2022] GET /identity/v3/role_assignments?user.id=ed17eeb1cc9a4844aefa6f1f4c46ae77&scope.project.id=8124b0df64044c7081c45bcfcde66bb2&role.id=bed8d7b5b8904606bcb0de011ef54ecd => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:47.159502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a974af-e171-45d8-aa30-08cfb6c9baee None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:47.160080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a974af-e171-45d8-aa30-08cfb6c9baee None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:47.160175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a974af-e171-45d8-aa30-08cfb6c9baee None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:47.161527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 567/1131] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:47.166699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:47.167142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:47.167283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:47.190362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:47.191592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:47.261959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 565/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:47.289607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a974af-e171-45d8-aa30-08cfb6c9baee None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:47.384478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a974af-e171-45d8-aa30-08cfb6c9baee None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:47.417692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040662b-15de-4e63-9a69-8c18d58cc829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:47.417839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040662b-15de-4e63-9a69-8c18d58cc829 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:47.418016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040662b-15de-4e63-9a69-8c18d58cc829 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:47.418292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040662b-15de-4e63-9a69-8c18d58cc829 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:47.419487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040662b-15de-4e63-9a69-8c18d58cc829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:47.420913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040662b-15de-4e63-9a69-8c18d58cc829 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:47.422495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 568/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:47.428809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:47.521735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9d7a6-9644-417f-b407-fc16610e44c1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:47.553114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3d91-c8b5-4592-ba67-999eb0915b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:47.553765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3d91-c8b5-4592-ba67-999eb0915b1d None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:47.554049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3d91-c8b5-4592-ba67-999eb0915b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:47.554324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3d91-c8b5-4592-ba67-999eb0915b1d None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:47.555029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3d91-c8b5-4592-ba67-999eb0915b1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:47.556475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3d91-c8b5-4592-ba67-999eb0915b1d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:47.581292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 566/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:30:47 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:49.804828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab79c4-6f59-489e-85e8-abc148d91de2 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:49.805347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab79c4-6f59-489e-85e8-abc148d91de2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:49.805347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab79c4-6f59-489e-85e8-abc148d91de2 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:49.806677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 569/1135] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:49.811726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:49.812106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:49.812283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:49.828352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:49.829500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:49.891252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 567/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:49.916191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab79c4-6f59-489e-85e8-abc148d91de2 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:50.014088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab79c4-6f59-489e-85e8-abc148d91de2 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:50.059218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b75e8-10ff-43e9-a840-f760ef761cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:50.059947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b75e8-10ff-43e9-a840-f760ef761cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:50.060233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b75e8-10ff-43e9-a840-f760ef761cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:50.060638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b75e8-10ff-43e9-a840-f760ef761cf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:50.062174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b75e8-10ff-43e9-a840-f760ef761cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:50.063954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b75e8-10ff-43e9-a840-f760ef761cf9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:50.066565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 570/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:50.072943 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:50.185732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559806-d09a-4e33-a9fc-61a5baa2689f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:50.219949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1d5d7-3663-4d72-a8d3-a80784fa62fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:50.220652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1d5d7-3663-4d72-a8d3-a80784fa62fa None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:50.220940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1d5d7-3663-4d72-a8d3-a80784fa62fa None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:50.221221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1d5d7-3663-4d72-a8d3-a80784fa62fa None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:50.222021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1d5d7-3663-4d72-a8d3-a80784fa62fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:50.223496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1d5d7-3663-4d72-a8d3-a80784fa62fa None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:50.247179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 568/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:30:50 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:30:52.543099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ea82f-6f0e-466a-8347-3c60396a4cef None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:52.543622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ea82f-6f0e-466a-8347-3c60396a4cef None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:52.543726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ea82f-6f0e-466a-8347-3c60396a4cef None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:52.545023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 571/1139] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:52.550117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:52.550483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:52.550676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:52.567550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:52.568772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:52.631078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 569/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:52.654870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ea82f-6f0e-466a-8347-3c60396a4cef None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:52.748229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ea82f-6f0e-466a-8347-3c60396a4cef None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:52.779648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:52.780407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:52.780686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:52.780961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:52.791004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:52.798465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:52.799581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:52.800469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 572/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:52.805371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:52.895601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf768-0612-4c32-a459-0545e441df90 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:52.927358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:52.928031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:52.928309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:52.928593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:52.929340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:52.929688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:52.931092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:52.938873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 570/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:52.945242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:53.037837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127914-29a9-4bea-ba67-7c1802643f11 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:53.068601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:53.069445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:53.069726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:53.070000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] PATH_INFO: `/v3/users/1fe6acb7785049b5ab1a1ae718d4a326` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:53.082162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] RBAC: Authorizing `identity:get_user(user_id=1fe6acb7785049b5ab1a1ae718d4a326)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:53.084348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:53.087310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 573/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:52 2022] GET /identity/v3/users/1fe6acb7785049b5ab1a1ae718d4a326 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:53.092990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:53.185257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff944da-5e3c-4a1c-8b98-d4dc19c76da4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:53.216789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:53.217424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:53.217707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:53.217982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:53.281029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:53.282459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:53.373536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 571/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 29 18:30:53.379363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:53.472240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4991d-6a13-4758-ba5f-6d565b183f4a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:53.503737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c63f08-d880-4173-9c9f-c6f78a2a9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:53.504571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c63f08-d880-4173-9c9f-c6f78a2a9ffc None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:53.504849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c63f08-d880-4173-9c9f-c6f78a2a9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:53.505120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c63f08-d880-4173-9c9f-c6f78a2a9ffc None admin] PATH_INFO: `/v3/projects/e9596a00b2e24c16995df3797a23c7c5` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:53.506894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c63f08-d880-4173-9c9f-c6f78a2a9ffc None admin] RBAC: Authorizing `identity:get_project(project_id=e9596a00b2e24c16995df3797a23c7c5)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:53.508357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c63f08-d880-4173-9c9f-c6f78a2a9ffc None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:53.510021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 574/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:53 2022] GET /identity/v3/projects/e9596a00b2e24c16995df3797a23c7c5 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:53.516386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:53.606966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d05aa-f594-443c-9d3b-12adf1488906 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:53.639940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:53.640514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:53.640797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:53.641075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:53.641901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=e9596a00b2e24c16995df3797a23c7c5, user.id=1fe6acb7785049b5ab1a1ae718d4a326) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:53.642210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:53.643749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16600bdb-501a-4acf-857c-411d777658fe None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:53.648900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 572/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:53 2022] GET /identity/v3/role_assignments?user.id=1fe6acb7785049b5ab1a1ae718d4a326&scope.project.id=e9596a00b2e24c16995df3797a23c7c5&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:55.816636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948899-dd2c-4adf-a312-65ade6be3f69 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:55.817128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948899-dd2c-4adf-a312-65ade6be3f69 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:55.817128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948899-dd2c-4adf-a312-65ade6be3f69 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:55.818494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 575/1147] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:55.823653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:55.824071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:55.824191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:55.840675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:55.841837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:55.903431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 573/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:55.926173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83948899-dd2c-4adf-a312-65ade6be3f69 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:56.020560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83948899-dd2c-4adf-a312-65ade6be3f69 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:56.051621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:56.052385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:56.052664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:56.052934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:56.062320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:56.070349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:56.071471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:30:56.072509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 576/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:56.077442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:56.169110 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5ff0-db05-4280-8785-12d97c335894 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:56.200479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:56.201133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:56.201414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:56.201685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:56.202423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:56.202727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:56.204254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:56.212429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 574/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:30:56.218176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:56.311072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33803dd-4b89-43e6-977f-ef79a4f82439 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:56.341877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:56.342654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:56.342930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:56.343233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] PATH_INFO: `/v3/users/1fe6acb7785049b5ab1a1ae718d4a326` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:56.344390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe6acb7785049b5ab1a1ae718d4a326)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:56.345806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:56.347400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 577/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:56 2022] GET /identity/v3/users/1fe6acb7785049b5ab1a1ae718d4a326 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:56.353570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:56.451383 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6dedb-c7ba-49bf-bf26-ae0ace711639 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:56.484435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94718-c162-4c35-b85a-023215af526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:56.485323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94718-c162-4c35-b85a-023215af526a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:56.485600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94718-c162-4c35-b85a-023215af526a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:56.485876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94718-c162-4c35-b85a-023215af526a None admin] PATH_INFO: `/v3/projects/e9596a00b2e24c16995df3797a23c7c5` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:56.487036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94718-c162-4c35-b85a-023215af526a None admin] RBAC: Authorizing `identity:get_project(project_id=e9596a00b2e24c16995df3797a23c7c5)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:56.488484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94718-c162-4c35-b85a-023215af526a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:56.490702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 575/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:56 2022] GET /identity/v3/projects/e9596a00b2e24c16995df3797a23c7c5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:56.496711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:56.589966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec6ddb-2040-4f05-9789-3ed8c3021534 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:56.621312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b443e-45d9-4ae0-8a56-6b96bb7bd117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:56.622185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b443e-45d9-4ae0-8a56-6b96bb7bd117 None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:56.622465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b443e-45d9-4ae0-8a56-6b96bb7bd117 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:56.622739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b443e-45d9-4ae0-8a56-6b96bb7bd117 None admin] PATH_INFO: `/v3/projects/e9596a00b2e24c16995df3797a23c7c5/users/1fe6acb7785049b5ab1a1ae718d4a326/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:56.624693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b443e-45d9-4ae0-8a56-6b96bb7bd117 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9596a00b2e24c16995df3797a23c7c5, user_id=1fe6acb7785049b5ab1a1ae718d4a326, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:56.626134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b443e-45d9-4ae0-8a56-6b96bb7bd117 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:56.639229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 578/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:30:56 2022] PUT /identity/v3/projects/e9596a00b2e24c16995df3797a23c7c5/users/1fe6acb7785049b5ab1a1ae718d4a326/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:30:58.834721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8790-96ab-4928-9954-aac8f493a20a None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:58.835243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8790-96ab-4928-9954-aac8f493a20a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:58.835243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8790-96ab-4928-9954-aac8f493a20a None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:58.836620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 576/1154] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:30:58.841709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:58.842103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:58.842266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:58.859005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:30:58.860205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:30:58.922075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 579/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:30:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:30:58.945725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8790-96ab-4928-9954-aac8f493a20a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:59.041177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8790-96ab-4928-9954-aac8f493a20a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:59.072196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:59.072971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:59.073256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:59.073532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:59.084054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:30:59.091578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:30:59.092668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:30:59.093747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 577/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:30:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:30:59.098382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:59.188760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5a8f3-ef06-424b-89be-2717baa5dc84 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:59.220768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:59.221418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:59.221701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:59.221977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:59.222716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:59.223021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:59.224454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:59.231992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 580/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:30:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:59.237559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:59.330862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc83ab-b446-4e4e-b8b1-291e7026f342 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:59.362068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:59.362919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:59.363232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:59.363511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] PATH_INFO: `/v3/users/1fe6acb7785049b5ab1a1ae718d4a326` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:59.365196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe6acb7785049b5ab1a1ae718d4a326)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:59.366612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:59.368230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 578/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:30:59 2022] GET /identity/v3/users/1fe6acb7785049b5ab1a1ae718d4a326 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:59.373624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:59.466535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db40f5-10aa-4bce-82bb-27c2130543ad None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:59.497730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:59.498368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:59.498655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:59.498929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:59.561592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:59.563321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:59.655155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 581/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:30:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:30:59.661127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:59.755266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c180-2ede-44bc-b128-de5ffcb2b9f2 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:59.787364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcc888-5e9d-47ef-8478-1585fb428692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:59.788208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcc888-5e9d-47ef-8478-1585fb428692 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:59.788492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcc888-5e9d-47ef-8478-1585fb428692 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:59.788770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcc888-5e9d-47ef-8478-1585fb428692 None admin] PATH_INFO: `/v3/projects/e9596a00b2e24c16995df3797a23c7c5` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:59.789941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcc888-5e9d-47ef-8478-1585fb428692 None admin] RBAC: Authorizing `identity:get_project(project_id=e9596a00b2e24c16995df3797a23c7c5)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:59.791405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcc888-5e9d-47ef-8478-1585fb428692 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:59.793077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 579/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:30:59 2022] GET /identity/v3/projects/e9596a00b2e24c16995df3797a23c7c5 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:30:59.798783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:30:59.893312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502b6e6-38ed-4819-a158-b64a37f94baa None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:30:59.924860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:30:59.925449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:30:59.925734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:30:59.926013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:30:59.926837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=e9596a00b2e24c16995df3797a23c7c5, user.id=1fe6acb7785049b5ab1a1ae718d4a326) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:30:59.927770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:30:59.929206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454ef3-a91e-431f-9feb-93a7963a0719 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:30:59.934700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 582/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:30:59 2022] GET /identity/v3/role_assignments?user.id=1fe6acb7785049b5ab1a1ae718d4a326&scope.project.id=e9596a00b2e24c16995df3797a23c7c5&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:02.153791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34e1d-a961-4534-876b-1a7ca894d56c None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:02.154355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34e1d-a961-4534-876b-1a7ca894d56c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:02.154355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34e1d-a961-4534-876b-1a7ca894d56c None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:02.155836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 580/1162] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:02.160891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:02.161310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:02.161486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:02.178189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:02.179444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:02.242951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 583/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:31:02.265550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34e1d-a961-4534-876b-1a7ca894d56c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:02.358275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34e1d-a961-4534-876b-1a7ca894d56c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:02.390028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:02.390686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:02.390967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:02.391272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:02.455827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:02.457217 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:02.554315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 581/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:31:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:31:02.560218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:02.651247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fedd94-807a-4698-82cd-e656a6749d4b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:02.683489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:02.684281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:02.684568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:02.684847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:02.691589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:02.693069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-523bf172-e1ec-420b-a238-5b4338532e59 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:31:02.707043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:31:02.708185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:31:02.709120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 584/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:31:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:31:02.714142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:02.819192 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aecea-c520-44e8-aa26-05ce618b0f62 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:02.850664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:02.851356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:02.851641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:02.851914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:02.852630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:31:02.852935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:02.854296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6d00a-ab88-4567-b913-c41873655280 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:02.861119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 582/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Apr 29 18:31:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:05.055963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95490d-351c-4b75-8af8-d65b6045782b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:05.056545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95490d-351c-4b75-8af8-d65b6045782b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:05.056545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95490d-351c-4b75-8af8-d65b6045782b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:05.057851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 585/1167] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:05.062879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e139dae-677b-4527-adaa-7f472b735659 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:05.063340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e139dae-677b-4527-adaa-7f472b735659 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:05.063477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e139dae-677b-4527-adaa-7f472b735659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:05.080129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6e139dae-677b-4527-adaa-7f472b735659 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:05.081316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6e139dae-677b-4527-adaa-7f472b735659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:05.143507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 583/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:31:05.166344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95490d-351c-4b75-8af8-d65b6045782b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:05.259344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95490d-351c-4b75-8af8-d65b6045782b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:05.290214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271d7b4-8ec7-4a5c-8d1f-cda2982e290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:05.290842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271d7b4-8ec7-4a5c-8d1f-cda2982e290a None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:05.291141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271d7b4-8ec7-4a5c-8d1f-cda2982e290a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:05.291420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271d7b4-8ec7-4a5c-8d1f-cda2982e290a None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:05.292147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271d7b4-8ec7-4a5c-8d1f-cda2982e290a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:05.293497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271d7b4-8ec7-4a5c-8d1f-cda2982e290a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:05.307492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 586/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Fri Apr 29 18:31:05 2022] POST /identity/v3/domains => generated 267 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:31:07.563990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d7d41-1f91-4f6c-9da6-0299bd2d75a1 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:07.564513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d7d41-1f91-4f6c-9da6-0299bd2d75a1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:07.564609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d7d41-1f91-4f6c-9da6-0299bd2d75a1 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:07.565908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 584/1170] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:07.571672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:07.572103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:07.572228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:07.589411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:07.590568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:07.651900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 587/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:31:07.674701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d7d41-1f91-4f6c-9da6-0299bd2d75a1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:07.769786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d7d41-1f91-4f6c-9da6-0299bd2d75a1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:07.801231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8866c-fa7e-4eec-ae41-13ceab492fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:07.802595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8866c-fa7e-4eec-ae41-13ceab492fea None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:07.802875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8866c-fa7e-4eec-ae41-13ceab492fea None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:07.803167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8866c-fa7e-4eec-ae41-13ceab492fea None admin] PATH_INFO: `/v3/domains/187ba5796d14484a925dcdac43633f74` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:07.812877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8866c-fa7e-4eec-ae41-13ceab492fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=187ba5796d14484a925dcdac43633f74)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:07.814308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8866c-fa7e-4eec-ae41-13ceab492fea None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:07.815950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 585/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Apr 29 18:31:07 2022] GET /identity/v3/domains/187ba5796d14484a925dcdac43633f74 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:07.822260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:07.913611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c481-2d2f-49a8-9bd7-fd7da2fb62df None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:07.945710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144ae4c-eef4-4b39-8dfb-edd9c4547b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:07.946345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ae4c-eef4-4b39-8dfb-edd9c4547b9b None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:07.946624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ae4c-eef4-4b39-8dfb-edd9c4547b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:07.946895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ae4c-eef4-4b39-8dfb-edd9c4547b9b None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:07.947611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144ae4c-eef4-4b39-8dfb-edd9c4547b9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:07.949026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144ae4c-eef4-4b39-8dfb-edd9c4547b9b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:07.973565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 588/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:31:07 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:31:10.225731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91115e-f6cf-417a-9a7f-4e867c522388 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:10.226264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91115e-f6cf-417a-9a7f-4e867c522388 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:10.226264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91115e-f6cf-417a-9a7f-4e867c522388 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:10.227681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 586/1174] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:10.232855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:10.233282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:10.233411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:10.249748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:10.250931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:10.313308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 589/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:31:10.338782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91115e-f6cf-417a-9a7f-4e867c522388 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:10.433936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91115e-f6cf-417a-9a7f-4e867c522388 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:10.466101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f51968-d50e-486d-8bbc-f6db002c2740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:10.466965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51968-d50e-486d-8bbc-f6db002c2740 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:10.467287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51968-d50e-486d-8bbc-f6db002c2740 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:10.467569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f51968-d50e-486d-8bbc-f6db002c2740 None admin] PATH_INFO: `/v3/domains/187ba5796d14484a925dcdac43633f74` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:10.468740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51968-d50e-486d-8bbc-f6db002c2740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=187ba5796d14484a925dcdac43633f74)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:10.470168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f51968-d50e-486d-8bbc-f6db002c2740 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:10.471823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 587/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Apr 29 18:31:10 2022] GET /identity/v3/domains/187ba5796d14484a925dcdac43633f74 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:10.477618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:10.569392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007646f-1f3a-4ed4-9f16-f58457fb4243 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:10.600137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e166-ece1-46ca-818e-f0c985a121d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:10.600790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e166-ece1-46ca-818e-f0c985a121d7 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:10.601073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e166-ece1-46ca-818e-f0c985a121d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:10.601350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e166-ece1-46ca-818e-f0c985a121d7 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:10.602044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292e166-ece1-46ca-818e-f0c985a121d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:10.603491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292e166-ece1-46ca-818e-f0c985a121d7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:10.621779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 590/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:31:10 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:31:12.913765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41df2c-b069-4aaa-819d-4a42218d9c4e None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:12.914300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41df2c-b069-4aaa-819d-4a42218d9c4e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:12.914300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41df2c-b069-4aaa-819d-4a42218d9c4e None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:12.915715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 588/1178] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:12.920924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:12.921325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:12.921482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:12.937593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:12.938762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:13.000448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 591/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:31:13.024148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41df2c-b069-4aaa-819d-4a42218d9c4e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:13.118211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41df2c-b069-4aaa-819d-4a42218d9c4e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:13.149617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:13.150393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:13.150672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:13.150942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:13.160753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:31:13.168892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:31:13.170048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:31:13.171212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 589/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:31:13.175817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:13.267258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b77acb-3709-4bbc-ba3d-130537136fe4 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:13.298582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:13.299262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:13.299548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:13.299827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:13.300566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:31:13.300872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:13.302278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:13.309799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 592/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:31:13.315255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:13.406491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d22e0c-ecb1-4dd2-8044-5a16c5e82593 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:13.437076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:13.437876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:13.438155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:13.438423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] PATH_INFO: `/v3/users/6cbb9513efa74a48975eb8145213096c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:13.451355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] RBAC: Authorizing `identity:get_user(user_id=6cbb9513efa74a48975eb8145213096c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:13.452781 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:13.454391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 590/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:31:13 2022] GET /identity/v3/users/6cbb9513efa74a48975eb8145213096c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:13.460847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:13.554744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739880-e862-4de8-8a08-7f266459a1a7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:13.586314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:13.586948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:13.587264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:13.587545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:13.650907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:13.652388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:13.743721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 593/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:31:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:31:13.749504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:13.842059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55630c14-3373-4f30-9304-31a3543274b2 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:13.873940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c255d-5099-45da-a982-6f5f5f47d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:13.874788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c255d-5099-45da-a982-6f5f5f47d77e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:13.875069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c255d-5099-45da-a982-6f5f5f47d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:13.875370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c255d-5099-45da-a982-6f5f5f47d77e None admin] PATH_INFO: `/v3/projects/d4b19439e5f94ed78c7073a741579f51` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:13.876550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c255d-5099-45da-a982-6f5f5f47d77e None admin] RBAC: Authorizing `identity:get_project(project_id=d4b19439e5f94ed78c7073a741579f51)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:13.877973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c255d-5099-45da-a982-6f5f5f47d77e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:13.879691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 591/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:31:13 2022] GET /identity/v3/projects/d4b19439e5f94ed78c7073a741579f51 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:13.886392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:13.976304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69cd5-8759-4ff7-a8fc-1eb235ff298f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:14.007465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:14.008041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:14.008320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:14.008590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:14.009404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=d4b19439e5f94ed78c7073a741579f51, user.id=6cbb9513efa74a48975eb8145213096c) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:31:14.009714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:14.011408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6466b-994f-4d87-b119-0149abda93e9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:14.016446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 594/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:31:13 2022] GET /identity/v3/role_assignments?user.id=6cbb9513efa74a48975eb8145213096c&scope.project.id=d4b19439e5f94ed78c7073a741579f51&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:16.226055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f216-923e-4eab-8b27-f4ed32265759 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:16.226605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f216-923e-4eab-8b27-f4ed32265759 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:16.226605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8f216-923e-4eab-8b27-f4ed32265759 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:16.228005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 592/1186] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:16.233243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:16.233656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:16.233797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:16.249801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:16.250954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:16.312786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 595/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:31:16.336144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f216-923e-4eab-8b27-f4ed32265759 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:16.429656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8f216-923e-4eab-8b27-f4ed32265759 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:16.462715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:16.463530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:16.463816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:16.464097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:16.473642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:31:16.481205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:31:16.482329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:31:16.483416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 593/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:31:16.488475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:16.580214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c03cef-7067-441c-b4fb-f2c4ec2d497a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:16.610777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:16.611451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:16.611733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:16.612005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:16.612739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:31:16.613041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:16.614959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:16.622462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 596/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:31:16.628364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:16.721475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5eb2-5041-4957-80dc-3e3f8d034ed4 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:16.752580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:16.753377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:16.753660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:16.753936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] PATH_INFO: `/v3/users/6cbb9513efa74a48975eb8145213096c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:16.755738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] RBAC: Authorizing `identity:get_user(user_id=6cbb9513efa74a48975eb8145213096c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:16.757173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:16.758756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 594/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:31:16 2022] GET /identity/v3/users/6cbb9513efa74a48975eb8145213096c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:16.764978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:16.856145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941ff4-9abc-4ea9-8623-b0d9f3554cdb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:16.887978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c33b-06b8-4f1b-b77e-ef7b11c3846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:16.888807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c33b-06b8-4f1b-b77e-ef7b11c3846d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:16.889085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c33b-06b8-4f1b-b77e-ef7b11c3846d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:16.889355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c33b-06b8-4f1b-b77e-ef7b11c3846d None admin] PATH_INFO: `/v3/projects/d4b19439e5f94ed78c7073a741579f51` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:16.890501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c33b-06b8-4f1b-b77e-ef7b11c3846d None admin] RBAC: Authorizing `identity:get_project(project_id=d4b19439e5f94ed78c7073a741579f51)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:16.891942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c33b-06b8-4f1b-b77e-ef7b11c3846d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:16.893600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 597/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:31:16 2022] GET /identity/v3/projects/d4b19439e5f94ed78c7073a741579f51 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:16.899389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:16.992547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8bf7a-0315-4acd-aa88-ccd11d8a0945 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:17.023367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f74ab-5e2c-4314-a2ea-386acc1d5dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:17.024185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f74ab-5e2c-4314-a2ea-386acc1d5dee None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:17.024466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f74ab-5e2c-4314-a2ea-386acc1d5dee None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:17.024743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f74ab-5e2c-4314-a2ea-386acc1d5dee None admin] PATH_INFO: `/v3/projects/d4b19439e5f94ed78c7073a741579f51/users/6cbb9513efa74a48975eb8145213096c/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:17.026666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f74ab-5e2c-4314-a2ea-386acc1d5dee None admin] RBAC: Authorizing `identity:create_grant(project_id=d4b19439e5f94ed78c7073a741579f51, user_id=6cbb9513efa74a48975eb8145213096c, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:17.028113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f74ab-5e2c-4314-a2ea-386acc1d5dee None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:17.040542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 595/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:31:16 2022] PUT /identity/v3/projects/d4b19439e5f94ed78c7073a741579f51/users/6cbb9513efa74a48975eb8145213096c/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:31:19.258410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d6a23-5e0d-4a92-be9b-bbcdf5c89304 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:19.258994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d6a23-5e0d-4a92-be9b-bbcdf5c89304 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:19.258994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d6a23-5e0d-4a92-be9b-bbcdf5c89304 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:19.260327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 598/1193] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:31:19.265698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:19.266134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:19.266261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:19.283007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:31:19.284201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:31:19.345770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 596/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:31:19.369537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d6a23-5e0d-4a92-be9b-bbcdf5c89304 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:19.465049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d6a23-5e0d-4a92-be9b-bbcdf5c89304 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:19.495438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:19.496215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:19.496495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:19.496767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:19.507826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:31:19.515531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:31:19.516623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:31:19.517810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 599/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:31:19.523249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:19.613908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02713d-aa0d-4f91-9a71-d974f6995d1b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:19.646313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:19.646967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:19.647278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:19.647556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:19.648294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:31:19.648601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:19.649964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:19.657529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 597/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:19.663041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:19.753767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959796-5b11-4c50-b50f-ef7dea45be0f None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:19.784944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:19.785726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:19.786032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:19.786303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] PATH_INFO: `/v3/users/6cbb9513efa74a48975eb8145213096c` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:19.787484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] RBAC: Authorizing `identity:get_user(user_id=6cbb9513efa74a48975eb8145213096c)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:19.788894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:19.790450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 600/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Apr 29 18:31:19 2022] GET /identity/v3/users/6cbb9513efa74a48975eb8145213096c => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:19.795987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:19.889437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d304-c4b8-4456-b9ff-c068e9382324 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:19.920283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:19.920916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:19.921197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:19.921468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:19.983786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:19.985214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:20.075697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 598/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:31:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:31:20.081558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:20.173440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a59e-1f8d-4205-883d-690f6b201e85 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:20.204425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c6322-992c-4a26-97d6-03377444f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:20.205253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c6322-992c-4a26-97d6-03377444f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:20.205533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c6322-992c-4a26-97d6-03377444f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:20.205802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c6322-992c-4a26-97d6-03377444f4f4 None admin] PATH_INFO: `/v3/projects/d4b19439e5f94ed78c7073a741579f51` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:20.206955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c6322-992c-4a26-97d6-03377444f4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=d4b19439e5f94ed78c7073a741579f51)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:20.208426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c6322-992c-4a26-97d6-03377444f4f4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:20.210067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 601/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Apr 29 18:31:20 2022] GET /identity/v3/projects/d4b19439e5f94ed78c7073a741579f51 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:31:20.216004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:31:20.307346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce094d-0303-4f93-8ebd-00694cddb23b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:31:20.338474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:31:20.339054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:31:20.339359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:31:20.339642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:31:20.340459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=d4b19439e5f94ed78c7073a741579f51, user.id=6cbb9513efa74a48975eb8145213096c) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:31:20.340770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:31:20.342189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6323e8-e76f-44d0-a38e-7734c6168f00 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:31:20.347679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 599/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:31:20 2022] GET /identity/v3/role_assignments?user.id=6cbb9513efa74a48975eb8145213096c&scope.project.id=d4b19439e5f94ed78c7073a741579f51&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:21.284756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5600-6c90-490e-97e0-c8c7adaf3a19 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:21.285391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5600-6c90-490e-97e0-c8c7adaf3a19 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:21.285391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5600-6c90-490e-97e0-c8c7adaf3a19 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:21.286817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 602/1201] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:21.292323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:21.292887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:21.292887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:21.310897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:21.312255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:21.390165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 600/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:21.417617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5600-6c90-490e-97e0-c8c7adaf3a19 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:21.540271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5600-6c90-490e-97e0-c8c7adaf3a19 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:21.581228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:21.582301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:21.582748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:21.583023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:21.595564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:21.597654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:21.616766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:21.617813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:21.618936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:21.618936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:21.618936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:21.618936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:21.618936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 603/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:21.625952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:21.745173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b1ca-b9dc-480f-b0fb-0ae3793ae795 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:21.784252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:21.785473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:21.785854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:21.786144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:21.786974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:21.787354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:21.788728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa99b-4156-43b0-aee8-2211b59b94a3 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:21.800950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 601/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:21.806355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:21.930771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414c635-6f32-4a3e-bcf1-d5a5ba3247a1 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:21.969628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d697f-b97a-4c48-ad5b-e997f66689b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:21.970641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d697f-b97a-4c48-ad5b-e997f66689b6 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:21.971200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d697f-b97a-4c48-ad5b-e997f66689b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:21.971660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d697f-b97a-4c48-ad5b-e997f66689b6 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:21.973392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d697f-b97a-4c48-ad5b-e997f66689b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:21.975291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d697f-b97a-4c48-ad5b-e997f66689b6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:22.003138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 604/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Apr 29 18:32:21 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:32:24.522848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1dc0c-b924-4de4-a7b3-44f88df5dc3e None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:24.523435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1dc0c-b924-4de4-a7b3-44f88df5dc3e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:24.523435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1dc0c-b924-4de4-a7b3-44f88df5dc3e None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:24.525199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 602/1206] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:24.533242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:24.533242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:24.533242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:24.551447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:24.552666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:24.635130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 605/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:24.656331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1dc0c-b924-4de4-a7b3-44f88df5dc3e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:24.773815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1dc0c-b924-4de4-a7b3-44f88df5dc3e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:24.810825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:24.811687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:24.812004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:24.812350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:24.823592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:32:24.832034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:24.833413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:24.834660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 603/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:24.839324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:24.944338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838f9a-a41e-456d-a674-6c0adb451351 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:24.987525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:24.988365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:24.988673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:24.988948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:24.989785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:24.990092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:24.991729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:25.002351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 606/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:32:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:25.008483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:25.122060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f7924-65bb-4640-9b77-9059810f395b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:25.161713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:25.162576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:25.162902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:25.163211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:25.174153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:25.175929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:25.195412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:25.196637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:25.197708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:25.197708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:25.197708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:25.197708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:25.197708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 604/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:25.202610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:25.311378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9bc9c-da21-4c2a-a160-1fa85f58a2b9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:25.350074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:25.350812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:25.351202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:25.351551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:25.352366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:25.352756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:25.354196 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:25.366268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 607/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:25.371657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:25.475854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24799d98-af09-4a97-a17a-0220db944d89 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:25.513324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:25.514519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:25.515018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:25.515413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:25.524334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:25.525780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:32:25.542182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:25.543502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:25.544474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 605/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:25.549865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:25.656721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f60487-845b-4d36-921f-9cc2057221b6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:25.693315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:25.694251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:25.694536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:25.694857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:25.695674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:25.695983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:25.697415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:25.718886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 608/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Apr 29 18:32:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:25.720541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:25.819713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6cac6-23f4-44ed-a9ae-50ff0b081c5a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:25.854616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:25.855316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:25.855602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:25.855879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:25.930689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:25.932352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:26.044440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 606/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:32:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 29 18:32:26.051340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:26.156228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5bd23-7257-4b94-8f20-b9e5df968e50 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:26.193416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:26.194360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:26.194741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:26.195148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:26.206778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:26.208405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:26.226774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:26.227778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:26.228769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:26.228769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:26.228769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:26.228769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:26.228992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 609/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:26.236210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:26.351386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985bd95-2a81-4cde-bad7-ddbb3d2d43d1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:26.390405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:26.391278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:26.391672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:26.392045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:26.392873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:26.393286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:26.395326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:26.412274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 607/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:26.414568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:26.532445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126edae8-b33f-4c87-b85c-04af59d8337e None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:26.571356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:26.572263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:26.572581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:26.573072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:26.582242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:26.583767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:32:26.598180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:26.599210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:26.600135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 610/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:26.605391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:26.716135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143676a-cea3-40de-9b11-847a91e092ef None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:26.750414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:26.751128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:26.751402 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:26.751683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:26.752483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:26.752802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:26.754775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa47ea-46af-4f1f-a87d-4d5477053baf None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:26.773796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 608/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:26.775846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:26.887163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7c10d-d028-4f39-ab6c-e1acc4b87bcb None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:26.924238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:26.924997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:26.925380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:26.925795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:26.926765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=ec1a79f8ea404a01b92ecabe8ca79b68) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:26.927101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:26.928557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b2b78-d47b-40bc-a5d2-68a28c8097d7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:26.935354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 611/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:32:26 2022] GET /identity/v3/role_assignments?user.id=ec1a79f8ea404a01b92ecabe8ca79b68&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:29.420675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d32192-d5c8-424e-9483-1146d1cc863d None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:29.421238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d32192-d5c8-424e-9483-1146d1cc863d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:29.421423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d32192-d5c8-424e-9483-1146d1cc863d None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:29.423170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 609/1220] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:29.428520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:29.428949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:29.429070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:29.446156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:29.447402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:29.520259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 612/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:29.543946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d32192-d5c8-424e-9483-1146d1cc863d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:29.650614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d32192-d5c8-424e-9483-1146d1cc863d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:29.684563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:29.685298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:29.685630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:29.685842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:29.699885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:32:29.708018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:29.709178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:32:29.710200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:29.714625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 610/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:29.715740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:29.819898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a6169-62a0-40b7-aa21-1003b788bf41 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:29.858024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:29.858969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:29.859475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:29.859818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:29.860939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] RBAC: Adding query filter params (name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:29.861317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:29.863462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:29.872113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 613/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:29.880350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:30.000875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012051-1330-4bc1-a79d-584af466b6ad None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:30.037782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:30.038751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:30.039146 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:30.039439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:30.051038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:30.052538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:30.069682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:30.070818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:30.073075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:30.073075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:30.073075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:30.073075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:30.073075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 611/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:30.077410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:30.179959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76f0d1-9f1a-4393-aa73-75231fba5067 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:30.215595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:30.216305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:30.216585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:30.216856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:30.217601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:30.217903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:30.219312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:30.233482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 614/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:30.239750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:30.352675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1446a-e57c-43fa-801c-3f085a0ff389 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:30.389036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:30.389854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:30.390134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:30.390414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:30.399260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:30.401014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:32:30.420656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:30.422263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:30.423442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 612/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:30.428873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:30.535787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067a83-90bf-40f4-9c74-1cb86a39f91c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:30.571078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:30.571758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:30.572118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:30.572366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:30.573273 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:30.573584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:30.575013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:30.595331 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 615/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Apr 29 18:32:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:30.602454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:30.713833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2bc4-08f1-48dd-a2e3-a9ddf63f55e0 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:30.749380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:30.750338 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:30.750659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:30.750928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:30.761610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:30.763043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:30.779835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:30.782103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:30.783233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:30.783233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:30.783233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:30.783233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:30.783233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 613/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:30.787312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:30.898825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691559e8-2427-4062-b2bc-fdd4d7f66f44 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:30.937225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:30.938329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:30.938678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:30.939127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:30.940199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:30.940597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:30.942812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:30.958133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 616/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:30.964393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:31.089497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dc241-8396-4662-ad44-987595f5032f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:31.127831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:31.128669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:31.128952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:31.129291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:31.137708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:31.139157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:32:31.153718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:31.154832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:31.155979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 614/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:31.161508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:31.259448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcef240-1125-4312-b9bf-9515f9d866c9 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:31.292118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:31.292760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:31.293044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:31.293320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:31.294098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:31.294400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:31.295862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5a65-42e6-47bc-8154-e4d4a16e0c3b None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:31.308135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 617/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:31.314393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:31.433439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4bf1-df7a-42dd-be51-52a15e78b35b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:31.476339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601ca5-e525-4a9f-8327-5954bf126fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:31.477245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601ca5-e525-4a9f-8327-5954bf126fce None admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:31.477533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601ca5-e525-4a9f-8327-5954bf126fce None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:31.477813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601ca5-e525-4a9f-8327-5954bf126fce None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/ec1a79f8ea404a01b92ecabe8ca79b68/roles/8b5fc479ee8d4f198e40c52280d43e5f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:31.496422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68601ca5-e525-4a9f-8327-5954bf126fce None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=ec1a79f8ea404a01b92ecabe8ca79b68, role_id=8b5fc479ee8d4f198e40c52280d43e5f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:31.498569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68601ca5-e525-4a9f-8327-5954bf126fce None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:31.514869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 615/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:32:31 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/ec1a79f8ea404a01b92ecabe8ca79b68/roles/8b5fc479ee8d4f198e40c52280d43e5f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:32:34.258160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473e1a-c7e6-47e5-91e5-b8b3a1b4f3a8 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:34.258792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473e1a-c7e6-47e5-91e5-b8b3a1b4f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:34.258792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473e1a-c7e6-47e5-91e5-b8b3a1b4f3a8 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:34.260315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 618/1233] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:34.267463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:34.267892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:34.268026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:34.286267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:34.287582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:34.365751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 616/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:34.391978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb473e1a-c7e6-47e5-91e5-b8b3a1b4f3a8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:34.499705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb473e1a-c7e6-47e5-91e5-b8b3a1b4f3a8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:34.535591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:34.536422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:34.536761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:34.537083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:34.547347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:32:34.556063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:34.557088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:34.558000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 619/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Apr 29 18:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:34.563328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:34.675811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef215d-4857-4dc4-baf4-0889cf9787b3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:34.710866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:34.711648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:34.711940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:34.712318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:34.713174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:34.713525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:34.715047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:34.724792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 617/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Apr 29 18:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:34.731021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:34.839570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536baf-f450-46d7-b907-5cbe660a0aef None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:34.874095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:34.875859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:34.875859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:34.875859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:34.887434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:34.889361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:34.910509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:34.911647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:34.912644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:34.912644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:34.912644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:34.912644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:34.912644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 620/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:34.918207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:35.039933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3fcfd-6c8f-4a5f-aa3d-99e37c7c57c1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:35.077373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:35.078099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:35.078412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:35.078795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:35.079600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:35.079908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:35.081315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:35.098609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 618/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:35.099935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:35.215045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2ebb3-cddb-4426-bd3a-ed0e4d114118 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:35.252785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:35.253608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:35.253887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:35.254160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:35.263251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:35.265049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:32:35.281945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:35.283154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:35.285936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 621/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:35.290142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:35.402643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830f041-6c42-4aa8-b499-afff7e42b772 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:35.437376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:35.438060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:35.438345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:35.438622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:35.439514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:35.439828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:35.441292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:35.462113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 619/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Apr 29 18:32:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:35.468253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:35.571988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f462a-c536-4552-9096-24eda1c753c3 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:35.609954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:35.610672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:35.610971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:35.611272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:35.688264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:35.689744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:35.791028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 622/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:32:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:32:35.796873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:35.900678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707cb9e-b185-4b1a-8909-8f6d5be05b70 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:35.945292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:35.946700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:35.947396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:35.947700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:35.964223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:35.965831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:35.986197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:35.987212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:35.988181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:35.988181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:35.988181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:35.988181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:35.988181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 620/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:35.993668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:36.104271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e194-bd95-4e07-ba91-a3a4f7d1b36a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:36.142552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:36.143280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:36.143593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:36.143867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:36.144627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:36.144933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:36.146302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:36.157457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 623/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:36.163164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:36.276079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a06d-4132-4cbb-85a8-c225542d3ca2 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:36.315014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:36.316592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:36.317086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:36.317392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:36.324420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:36.325902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:32:36.339584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:36.340706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:36.341843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:36.345750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 621/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:36.346952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:36.466759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80980015-a11b-4216-9e61-bfe4579fcf82 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:36.501608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:36.502277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:36.502554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:36.502855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:36.503677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:36.503981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:36.505743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab18e4-6e54-46b5-9f43-72bfe6df6a38 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:36.519459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 624/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:36.525725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:36.629289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556671-ecb7-4886-9ca8-a7549162da1d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:36.664490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:36.665338 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:36.665584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:36.665941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:36.666844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] RBAC: Adding query filter params (role.id=8b5fc479ee8d4f198e40c52280d43e5f, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=ec1a79f8ea404a01b92ecabe8ca79b68) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:36.667260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:36.668912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbde94c-eacc-44aa-b2f6-009bbafb9d53 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:36.676191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 622/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:32:36 2022] GET /identity/v3/role_assignments?user.id=ec1a79f8ea404a01b92ecabe8ca79b68&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=8b5fc479ee8d4f198e40c52280d43e5f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:38.981377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f09bb-4111-4ffb-ab33-291c54ae7a35 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:38.982028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f09bb-4111-4ffb-ab33-291c54ae7a35 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:38.982028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f09bb-4111-4ffb-ab33-291c54ae7a35 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:38.983318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 625/1247] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:32:38.988608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:38.989084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:38.989187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:39.008194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:39.009397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:39.077927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 623/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:39.102526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f09bb-4111-4ffb-ab33-291c54ae7a35 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:39.211545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f09bb-4111-4ffb-ab33-291c54ae7a35 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:39.250161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:39.250899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:39.251223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:39.251533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:39.262612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:32:39.270284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:39.271525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:39.272537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 626/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:39.278137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:39.392006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b78290-9741-473f-bb67-8a374cf33ba3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:39.431323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:39.432024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:39.432305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:39.432578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:39.433346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:39.433653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:39.435064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:39.444563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 624/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:39.450524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:39.552940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52672-18d1-4f8d-a922-76a4a0e87543 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:39.586105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:39.586915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:39.587230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:39.587504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:39.599411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:39.600892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:39.619491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:39.620659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:39.621580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:39.621580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:39.621580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:39.621580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:39.621580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 627/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:39.626681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:39.726681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e911-da27-4568-b3a0-c7d2b4b70c6d None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:39.759827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:39.760503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:39.760796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:39.761319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:39.762050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:39.762372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:39.763778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:39.775916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 625/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:39.782067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:39.880020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14deb14-5c66-4dd0-a7a9-41cb2af67324 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:39.914975 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:39.915810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:39.916091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:39.916369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:39.923862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:39.925293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:32:39.939559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:39.941109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:39.942356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 628/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:39.947455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:40.057880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a9888-59b8-439f-8e06-26a37fefbfa5 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:40.089418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:40.090092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:40.090380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:40.090657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:40.091535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:40.091847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:40.093275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:40.110026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 626/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Apr 29 18:32:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:40.115727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:40.209671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a261e6-989f-46e2-ac22-9b048957b791 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:40.240292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:40.240925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:40.241210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:40.241488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:40.307482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:40.308932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:40.402003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 629/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:32:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:32:40.407857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:40.499287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404566a-a9b8-455a-9f0b-7ef5243097ea None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:40.531250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:40.532027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:40.532308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:40.532582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:40.541919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:40.543367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:40.561030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:40.562054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:40.563144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:40.563144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:40.563144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:40.563144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:40.563144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 627/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:40.568424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:40.659077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af65926-dde9-4990-87c0-97f044a068b4 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:40.691089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:40.691761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:40.692075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:40.692323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:40.693037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:40.693346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:40.694704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:40.705230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 630/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:40.710649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:40.803140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596882e-6482-47bc-83aa-3a2982671238 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:40.834602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:40.835426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:40.835709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:40.835984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:40.842237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:40.843695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:32:40.858343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:40.859430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:40.865362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 628/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:32:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:40.865901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:40.963169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608fa8c-c173-4dc8-837a-f693e03e8bd6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:41.001261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:41.002149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:41.002459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:41.002929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:41.004132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:41.004672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:41.006802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db445ed1-25be-4050-a06c-edae649cd957 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:41.019614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 631/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:32:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:41.025655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:41.117940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4ffc-5108-46e4-bc33-f3b27ad83a6c None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:41.148494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:41.149127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:41.149408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:41.149681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:41.150504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=ec1a79f8ea404a01b92ecabe8ca79b68) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:41.150808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:41.152248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfebf0-3e58-41ae-bf6e-5bfed202d53f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:41.157350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 629/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:32:41 2022] GET /identity/v3/role_assignments?user.id=ec1a79f8ea404a01b92ecabe8ca79b68&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:43.362191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5309-1230-491b-b764-5b18e702a388 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:43.362755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5309-1230-491b-b764-5b18e702a388 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:43.362755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5309-1230-491b-b764-5b18e702a388 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:43.364138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 632/1261] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:43.369420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:43.369858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:43.369958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:43.386933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:43.388136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:43.450070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 630/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 18:32:43.472375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5309-1230-491b-b764-5b18e702a388 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:43.567174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5309-1230-491b-b764-5b18e702a388 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:43.597955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489665e-2976-414a-998f-120dc27edcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:43.598722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489665e-2976-414a-998f-120dc27edcda None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:43.599004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489665e-2976-414a-998f-120dc27edcda None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:43.599314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489665e-2976-414a-998f-120dc27edcda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:43.608824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489665e-2976-414a-998f-120dc27edcda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-e489665e-2976-414a-998f-120dc27edcda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:32:43.616985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:43.618064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:43.619146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 633/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 18:32:43.624509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:43.714648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3e101-d6e8-4752-a783-89868154ac70 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:43.745587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:43.746236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:43.746515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:43.746788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:43.747555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:43.747859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:43.749205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:43.757292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 631/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:43.763148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489665e-2976-414a-998f-120dc27edcda None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:43.854540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489665e-2976-414a-998f-120dc27edcda None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:43.885777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:43.886745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:43.887022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:43.887317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:43.897143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:43.898563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:43.915093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:43.916220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:43.917201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:43.917201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:43.917201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:43.917201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:43.917201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 634/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:43.921633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.023260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64641-6818-4044-acf8-5457b5d10a29 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.055015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.055697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.055982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.056258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.056978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:44.057289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.058646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.069753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 632/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:44.075344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.168522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d697e-4d4d-4c19-8b33-ae8f9f2c4586 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.199318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.200093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.200433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.200710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.207739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.209180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:32:44.223375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:44.224503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:44.225852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 635/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:44.230067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.324099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e8cf-9133-462f-9cc4-213a37335b86 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.358121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.358958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.359298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.359576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.360420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:44.360725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.362323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.379574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 633/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Apr 29 18:32:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:44.385294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.478679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399deb8d-52ab-4a90-bc18-9ee291491ff6 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.508846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.509620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.509899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.510166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.520779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.522207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:44.538856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:44.539937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:44.541172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:44.541172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:44.541172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:44.541172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:44.541172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 636/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:44.545675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.637763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a80ab-5f78-4d4f-be6e-2ad2ed938a0f None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.670947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.671661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.671951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.672223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.672947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:44.673277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.674694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.685467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 634/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:44.691509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.786012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b7116-5b38-4de6-b805-acf15fc9c31c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.816977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.817757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.818039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.818316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.824632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.826075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:32:44.840288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:44.841333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:44.842267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 637/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:44.847439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:44.939863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d8306-e59c-4941-98be-0a24465a5490 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:44.974605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:44.975313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:44.975603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:44.975884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:44.976680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:44.976999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:44.978439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f249be-e382-4f4f-8b1a-863cf47d1c6f None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:44.990104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 635/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:32:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:44.996164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:45.089476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496ca8-e46e-4fd0-a19f-091ccc7065a7 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:45.120919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebab800-4c09-4b28-a024-ffa6c1496a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:45.121778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebab800-4c09-4b28-a024-ffa6c1496a2a None admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:45.122062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebab800-4c09-4b28-a024-ffa6c1496a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:45.122341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebab800-4c09-4b28-a024-ffa6c1496a2a None admin] PATH_INFO: `/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/ec1a79f8ea404a01b92ecabe8ca79b68/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:45.124276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebab800-4c09-4b28-a024-ffa6c1496a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=79fac263d60b4f41b94ae64f0d4ff57f, user_id=ec1a79f8ea404a01b92ecabe8ca79b68, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:45.125706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebab800-4c09-4b28-a024-ffa6c1496a2a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:45.138566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 638/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Apr 29 18:32:44 2022] PUT /identity/v3/projects/79fac263d60b4f41b94ae64f0d4ff57f/users/ec1a79f8ea404a01b92ecabe8ca79b68/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:32:47.419753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08f7fd-bf6d-42e4-9557-078224ecd00d None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:47.420319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08f7fd-bf6d-42e4-9557-078224ecd00d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:47.420319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08f7fd-bf6d-42e4-9557-078224ecd00d None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:47.421679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 636/1274] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:47.428158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:47.428558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:47.428810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:47.446265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:47.447469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:47.511656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 639/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:47.537705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08f7fd-bf6d-42e4-9557-078224ecd00d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:47.634922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08f7fd-bf6d-42e4-9557-078224ecd00d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:47.666860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:47.667665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:47.667951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:47.668230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:47.677889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 18:32:47.685406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:47.686475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:47.687521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 637/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Apr 29 18:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:47.693055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:47.785832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5db3a-a11f-4d19-8e6a-b5850eb606ac None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:47.817150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:47.817793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:47.818072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:47.818341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:47.819069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:47.819397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:47.820751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:47.828228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 640/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Apr 29 18:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:47.834275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:47.926629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a3d4-601f-4f97-85a1-b45001497c43 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:47.958667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:47.959438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:47.959646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:47.959943 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:47.970926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:47.972898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:47.990090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:47.991060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:47.992317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:47.992317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:47.992317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:47.992317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:47.992317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 638/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:47.997384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:48.093845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29824-939e-4490-ba19-a51237f24c13 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:48.124715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:48.125366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:48.125646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:48.125917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:48.126625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:48.126928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:48.129042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:48.140252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 641/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:48.146649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:48.239022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef76b03-8a48-4167-a0ee-cc2806f965e6 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:48.270679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:48.271501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:48.271786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:48.272057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:48.279098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:48.280550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 18:32:48.294877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:48.296014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:48.297000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 639/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:48.301718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:48.395419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9122e-827f-43e6-8daf-5103ea658f05 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:48.428370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:48.429019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:48.429301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:48.429575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:48.430404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:48.430711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:48.432169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:48.449046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 642/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Apr 29 18:32:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:48.454632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:48.546967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa3407-2138-4807-8e3f-87907a582391 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:48.578753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:48.579418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:48.579700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:48.579974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:48.641643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:48.643137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:48.735351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 640/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Apr 29 18:32:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 18:32:48.741265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:48.832700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0548d-8652-467b-8b31-401137d638cf None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:48.863557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:48.864326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:48.864607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:48.864881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:48.874249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:48.875723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 18:32:48.892979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:48.894447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:48.896284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 18:32:48.896284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 18:32:48.896284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 18:32:48.896284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:48.896284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 643/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:48.900661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:48.995684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375bf0b-4a46-4e7d-b38e-af9f7c10bad1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:49.027713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:49.028372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:49.028659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:49.028938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:49.029660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:49.029971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:49.031361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:49.042032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 641/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Apr 29 18:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:49.047679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:49.141163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6962-a3a2-48b5-9b3b-51878655542c None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:49.173761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:49.175137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:49.175424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:49.175699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:49.182080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:49.183559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 18:32:49.196845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:49.197848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: ERROR keystone.server.flask.application Apr 29 18:32:49.198947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 644/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Apr 29 18:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:49.203669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:49.297813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d207-7ebd-416b-a2e3-cb510beb5a55 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:49.329064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:49.329715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:49.329997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:49.330273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:49.331050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:49.331385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:49.332804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009697e-eeb5-4c93-aafd-2f5541af3027 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:49.344218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 642/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Apr 29 18:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:49.350630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:49.443304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aebe7-ffb0-4d89-99a6-11122b82e374 None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:49.474700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:49.475364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:49.475647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:49.475923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:49.476745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] RBAC: Adding query filter params (role.id=77248c1ae58244c1b1b570bc66fa8103, scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f, user.id=ec1a79f8ea404a01b92ecabe8ca79b68) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:49.477055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:49.478473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b002d-8b85-48db-b40f-056e3b452aa6 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:49.483976 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 645/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Apr 29 18:32:49 2022] GET /identity/v3/role_assignments?user.id=ec1a79f8ea404a01b92ecabe8ca79b68&scope.project.id=79fac263d60b4f41b94ae64f0d4ff57f&role.id=77248c1ae58244c1b1b570bc66fa8103 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:51.723309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d7b0-a549-43af-8f67-416b70907c97 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:51.723811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d7b0-a549-43af-8f67-416b70907c97 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:51.723811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d7b0-a549-43af-8f67-416b70907c97 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:51.725126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 643/1288] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:51.730208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:51.730595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:51.730759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:51.746808 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:51.747998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:51.812027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 646/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:51.834210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d7b0-a549-43af-8f67-416b70907c97 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:51.928023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d7b0-a549-43af-8f67-416b70907c97 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:51.963350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:51.964159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:51.964516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:51.964803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:51.965657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:51.967264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:51.980035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:51.981169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:51.982039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 644/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:32:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:51.988915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:52.085351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32076dff-2c92-4995-8ce0-e2067511cfa8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:52.116528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:52.117177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:52.117457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:52.117732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:52.118433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:52.118735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:52.120129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6f473-2856-44cd-bd56-d85f52973e9d None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:52.124650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 647/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Apr 29 18:32:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:52.130937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:52.223329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0cd7e-d7eb-423f-9a65-4a3a2f17dcf1 None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:52.254542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:52.255147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:52.255437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:52.255710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] PATH_INFO: `/v3/services` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:52.256407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:52.256710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:52.258064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554d2f-32eb-4788-928a-da81f3d6138e None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:52.262494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 645/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Apr 29 18:32:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:54.449886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a907-8e53-45b5-b336-67178ece7e00 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:54.450408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a907-8e53-45b5-b336-67178ece7e00 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:54.450408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a907-8e53-45b5-b336-67178ece7e00 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:54.451810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 648/1293] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:54.457548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171de5f-1da4-4715-8757-c52f14f08073 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:54.457951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171de5f-1da4-4715-8757-c52f14f08073 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:54.458107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171de5f-1da4-4715-8757-c52f14f08073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:54.474245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b171de5f-1da4-4715-8757-c52f14f08073 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:54.475453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b171de5f-1da4-4715-8757-c52f14f08073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:54.537379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 646/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:54.559468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a907-8e53-45b5-b336-67178ece7e00 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:54.652954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a907-8e53-45b5-b336-67178ece7e00 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:54.683488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e676f-3db8-49b8-8a70-08fa5743b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:54.684124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e676f-3db8-49b8-8a70-08fa5743b705 None admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:54.684403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e676f-3db8-49b8-8a70-08fa5743b705 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:54.684674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e676f-3db8-49b8-8a70-08fa5743b705 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:54.685385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e676f-3db8-49b8-8a70-08fa5743b705 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:54.686733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e676f-3db8-49b8-8a70-08fa5743b705 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:54.699784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 649/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Apr 29 18:32:54 2022] POST /identity/v3/services => generated 246 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:32:56.922104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9be0-5dc3-4d0c-9b04-51a1335b0a8e None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:56.922628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9be0-5dc3-4d0c-9b04-51a1335b0a8e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:56.922748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9be0-5dc3-4d0c-9b04-51a1335b0a8e None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:56.924219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 647/1296] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:56.929362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:56.929756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:56.929919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:56.947519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:56.948928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:57.022723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 650/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:57.045481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9be0-5dc3-4d0c-9b04-51a1335b0a8e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:57.140536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9be0-5dc3-4d0c-9b04-51a1335b0a8e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:57.171555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:57.172393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:57.172629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:57.172906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:57.173554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:57.175461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:32:57.186917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:32:57.188090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:32:57.189271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 648/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:32:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:32:57.194421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:57.285756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66f0b-5c07-4a90-8627-3b8513135d49 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:57.318221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:57.318869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:57.319176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:57.319456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:57.320154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:57.320460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:57.321836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:57.326651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 651/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Apr 29 18:32:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:32:57.332421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:57.426117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674d69-2d0a-47d8-aa24-e4593691245a None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:57.457165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:57.457851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:57.458133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:57.458415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:57.459225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] RBAC: Adding query filter params (interface=public, service_id=c978260c50854e9cb712ab5c1df64bed, region_id=RegionOne) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:32:57.459536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:57.460900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629206-0cb9-4d2e-869e-e3fd12a9fdd5 None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:57.465783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 649/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Apr 29 18:32:57 2022] GET /identity/v3/endpoints?service_id=c978260c50854e9cb712ab5c1df64bed&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:32:57.471980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:32:57.564032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d59ee-62e4-42b7-aad0-4ba3dbc8655a None admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:32:57.594749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbe384-b9f7-4b51-8b84-b7c20eb719b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:32:57.595418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbe384-b9f7-4b51-8b84-b7c20eb719b9 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:57.595700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbe384-b9f7-4b51-8b84-b7c20eb719b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:57.596483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbe384-b9f7-4b51-8b84-b7c20eb719b9 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:57.597150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbe384-b9f7-4b51-8b84-b7c20eb719b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:32:57.598503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbe384-b9f7-4b51-8b84-b7c20eb719b9 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:32:57.604902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 652/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Apr 29 18:32:57 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:32:59.816347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc456-5101-4667-81e7-ac932b80e888 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:59.816870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc456-5101-4667-81e7-ac932b80e888 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:59.816870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc456-5101-4667-81e7-ac932b80e888 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:59.818175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 650/1302] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:32:59.823191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:32:59.823578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:32:59.823752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:32:59.840349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:32:59.841508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:32:59.903404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 653/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 18:32:59.925889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbc456-5101-4667-81e7-ac932b80e888 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:33:00.023748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbc456-5101-4667-81e7-ac932b80e888 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:33:00.064252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:33:00.065691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:33:00.065971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:33:00.066244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:33:00.066945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:33:00.068292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 18:33:00.079640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 18:33:00.080828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application with Lock( Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self._enter() Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application return self.creator() Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application created_value = creator( Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: ERROR keystone.server.flask.application Apr 29 18:33:00.081857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 651/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Apr 29 18:32:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 18:33:00.086873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:33:00.178535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa520cf-b73b-4977-8778-ab01192ec04b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:33:00.210136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:33:00.210783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:33:00.211069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:33:00.211381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] PATH_INFO: `/v3/services` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:33:00.212076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:33:00.212384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:33:00.213752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6eea-9c41-4f2e-8c6a-3d2c71b507f2 None admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:33:00.218624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 654/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Apr 29 18:33:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:33:00.224166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:33:00.317884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57891-4b06-4e00-a501-19ba8610ff1b None admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:33:00.348197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f0344-a4d7-4760-bcab-349bfaabbedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:33:00.348835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f0344-a4d7-4760-bcab-349bfaabbedf None admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:33:00.349125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f0344-a4d7-4760-bcab-349bfaabbedf None admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:33:00.349405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f0344-a4d7-4760-bcab-349bfaabbedf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:33:00.350139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f0344-a4d7-4760-bcab-349bfaabbedf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:33:00.351519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f0344-a4d7-4760-bcab-349bfaabbedf None admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:33:00.368690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 652/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Apr 29 18:33:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:34:03.105388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e902ffd-6a27-4079-808d-fa727cb18c20 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:03.106402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e902ffd-6a27-4079-808d-fa727cb18c20 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:03.106899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e902ffd-6a27-4079-808d-fa727cb18c20 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:03.112854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 655/1307] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:03.114297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c99fd4-41a5-44da-a7d0-daf864c3ce9f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:03.114707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c99fd4-41a5-44da-a7d0-daf864c3ce9f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:03.114916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c99fd4-41a5-44da-a7d0-daf864c3ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:03.202325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-70c99fd4-41a5-44da-a7d0-daf864c3ce9f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:03.203774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-70c99fd4-41a5-44da-a7d0-daf864c3ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:03.325524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 653/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:34:03.408115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91e19c-babd-4431-9622-a3f86739343b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:03.409207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91e19c-babd-4431-9622-a3f86739343b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:03.410449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91e19c-babd-4431-9622-a3f86739343b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:03.415898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 656/1309] 10.222.0.45 () {54 vars in 964 bytes} [Fri Apr 29 18:34:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:03.432789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd473-80e3-4607-9abc-72647ef6d94a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:03.433143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd473-80e3-4607-9abc-72647ef6d94a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:03.433337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd473-80e3-4607-9abc-72647ef6d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:03.520670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ef0dd473-80e3-4607-9abc-72647ef6d94a None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:03.522171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ef0dd473-80e3-4607-9abc-72647ef6d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:03.600774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 654/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Apr 29 18:34:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:03.609756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91e19c-babd-4431-9622-a3f86739343b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:03.612075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5a91e19c-babd-4431-9622-a3f86739343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:03.718434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91e19c-babd-4431-9622-a3f86739343b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:03.791225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:03.791888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:03.792174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:03.792456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:03.795024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:03.905488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:03.906926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71be990-2938-4388-8ac3-98492430f9b9 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:03.925075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 657/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:06.451073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97db7-ce99-4dfa-9bb7-22997e76adea None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:06.451573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97db7-ce99-4dfa-9bb7-22997e76adea None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:06.451653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97db7-ce99-4dfa-9bb7-22997e76adea None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:06.453025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 655/1312] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:06.458768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e14f-d055-4eb1-8c96-027dfa582f90 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:06.459624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e14f-d055-4eb1-8c96-027dfa582f90 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:06.460110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e14f-d055-4eb1-8c96-027dfa582f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:06.541870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3017e14f-d055-4eb1-8c96-027dfa582f90 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:06.543494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3017e14f-d055-4eb1-8c96-027dfa582f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:06.641349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 658/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:06.679163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97db7-ce99-4dfa-9bb7-22997e76adea None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:06.680845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-66f97db7-ce99-4dfa-9bb7-22997e76adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:06.788748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97db7-ce99-4dfa-9bb7-22997e76adea None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:06.868556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:06.869228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:06.869516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:06.869797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:06.871550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:06.983373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:06.985059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11996c-c818-4f56-8674-b52fa4c7f011 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:07.003671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 656/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:09.585886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824925fd-40cf-4068-ac0f-7f79b8029760 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:09.586501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824925fd-40cf-4068-ac0f-7f79b8029760 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:09.586501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824925fd-40cf-4068-ac0f-7f79b8029760 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:09.587827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 659/1315] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:09.592888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2bba-272f-403e-b567-632950121bd3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:09.593306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2bba-272f-403e-b567-632950121bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:09.593437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2bba-272f-403e-b567-632950121bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:09.654956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f0db2bba-272f-403e-b567-632950121bd3 None None] MFA Rules not processed for user `35318d0a3f124e09a063f09d2f564d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:09.656187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f0db2bba-272f-403e-b567-632950121bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:09.746111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 657/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:09.785161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824925fd-40cf-4068-ac0f-7f79b8029760 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:09.786666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-824925fd-40cf-4068-ac0f-7f79b8029760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:09.885279 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824925fd-40cf-4068-ac0f-7f79b8029760 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:09.955043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:09.955710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:09.955993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:09.956269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:09.957902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:10.059812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:10.061181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67683b5-2550-480e-86d3-1167e4000082 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:10.080302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 660/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:34:12.823077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18db95-edd8-4944-985e-b3eb533c296e None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:12.823661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18db95-edd8-4944-985e-b3eb533c296e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:12.823661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18db95-edd8-4944-985e-b3eb533c296e None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:12.824952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 658/1318] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:12.829997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340841-92f2-4489-ae0b-f323a5fab4a5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:12.830417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340841-92f2-4489-ae0b-f323a5fab4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:12.830558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340841-92f2-4489-ae0b-f323a5fab4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:12.892425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c3340841-92f2-4489-ae0b-f323a5fab4a5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:12.893617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c3340841-92f2-4489-ae0b-f323a5fab4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:12.991557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 661/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:13.045998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa491-aab0-460c-bcf7-3c55ee7c3876 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:13.046285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa491-aab0-460c-bcf7-3c55ee7c3876 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:13.046594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa491-aab0-460c-bcf7-3c55ee7c3876 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:13.048504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 659/1320] 10.222.0.45 () {54 vars in 964 bytes} [Fri Apr 29 18:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:13.054667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658674b7-48a7-48a4-a43a-f098bc5c2214 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:13.054953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658674b7-48a7-48a4-a43a-f098bc5c2214 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:13.055264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658674b7-48a7-48a4-a43a-f098bc5c2214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:13.125698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-658674b7-48a7-48a4-a43a-f098bc5c2214 None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:13.127508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-658674b7-48a7-48a4-a43a-f098bc5c2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:13.197957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 662/1321] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Apr 29 18:34:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:13.206914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa491-aab0-460c-bcf7-3c55ee7c3876 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:13.208542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-692fa491-aab0-460c-bcf7-3c55ee7c3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:13.306458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa491-aab0-460c-bcf7-3c55ee7c3876 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:13.375396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:13.375990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:13.376269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:13.376539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:13.378161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:13.479838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:13.481271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbad8-d89c-494a-89c8-407d0213bf3f service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:13.498869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 660/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:16.814941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e64c-728a-42cc-97cc-dbde78e7f4cc None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:16.815501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e64c-728a-42cc-97cc-dbde78e7f4cc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:16.815501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1e64c-728a-42cc-97cc-dbde78e7f4cc None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:16.816804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 663/1323] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:16.822112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242dd7-7d1c-4002-8648-d4d8f44ba57f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:16.822514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242dd7-7d1c-4002-8648-d4d8f44ba57f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:16.822799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242dd7-7d1c-4002-8648-d4d8f44ba57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:16.886078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-eb242dd7-7d1c-4002-8648-d4d8f44ba57f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:16.887555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-eb242dd7-7d1c-4002-8648-d4d8f44ba57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:16.980663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 661/1324] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:17.017139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e64c-728a-42cc-97cc-dbde78e7f4cc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:17.018745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3ea1e64c-728a-42cc-97cc-dbde78e7f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:17.119179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1e64c-728a-42cc-97cc-dbde78e7f4cc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:17.194371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:17.195019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:17.195329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:17.195607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:17.197238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:17.302798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:17.304282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a664aa-ac7c-4bed-a77f-781ae308a5d7 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:17.323527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 664/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:19.647653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415877dd-6620-4594-a11c-fbd68c259438 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:19.648199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415877dd-6620-4594-a11c-fbd68c259438 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:19.648199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415877dd-6620-4594-a11c-fbd68c259438 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:19.649598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 662/1326] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:19.654715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11804c-c8b9-45a3-9d64-6fe24c57fed3 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:19.655153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11804c-c8b9-45a3-9d64-6fe24c57fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:19.655420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11804c-c8b9-45a3-9d64-6fe24c57fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:19.718538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0b11804c-c8b9-45a3-9d64-6fe24c57fed3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:19.719770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0b11804c-c8b9-45a3-9d64-6fe24c57fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:19.815158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 665/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:19.850151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415877dd-6620-4594-a11c-fbd68c259438 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:19.851740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-415877dd-6620-4594-a11c-fbd68c259438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:19.954906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415877dd-6620-4594-a11c-fbd68c259438 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:20.025446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:20.026015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:20.026325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:20.026596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:20.028247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:20.134219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:20.135715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639a934-f371-494b-8d9b-f93f3d8507cf service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:20.153349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 663/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:22.456615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beaa62-3ca8-48cb-8252-16e9ef31bc08 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:22.457175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beaa62-3ca8-48cb-8252-16e9ef31bc08 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:22.457175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beaa62-3ca8-48cb-8252-16e9ef31bc08 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:22.458584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 666/1329] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:22.463894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf6ef-72de-43c1-976f-e140f9b64854 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:22.464299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf6ef-72de-43c1-976f-e140f9b64854 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:22.464460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf6ef-72de-43c1-976f-e140f9b64854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:22.529473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0f3cf6ef-72de-43c1-976f-e140f9b64854 None None] MFA Rules not processed for user `35318d0a3f124e09a063f09d2f564d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:22.530832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0f3cf6ef-72de-43c1-976f-e140f9b64854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:22.625048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 664/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:22.662450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beaa62-3ca8-48cb-8252-16e9ef31bc08 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:22.664115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b4beaa62-3ca8-48cb-8252-16e9ef31bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:22.764151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beaa62-3ca8-48cb-8252-16e9ef31bc08 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:22.838533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:22.839220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:22.839507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:22.839794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:22.841439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:22.946807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:22.948301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd057ed0-f4a1-4b5e-8048-5514546b0820 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:22.965641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 667/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:25.475982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1a7fe-8b91-4e75-9b33-d276b539a898 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:25.476483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1a7fe-8b91-4e75-9b33-d276b539a898 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:25.476597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1a7fe-8b91-4e75-9b33-d276b539a898 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:25.477961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 665/1332] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:25.483226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ad8f3-1644-4794-8aff-a48a3c4dc5b9 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:25.483652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ad8f3-1644-4794-8aff-a48a3c4dc5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:25.483884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ad8f3-1644-4794-8aff-a48a3c4dc5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:25.549864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-228ad8f3-1644-4794-8aff-a48a3c4dc5b9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:25.550970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-228ad8f3-1644-4794-8aff-a48a3c4dc5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:25.643948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 668/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:34:25.678667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1a7fe-8b91-4e75-9b33-d276b539a898 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:25.680278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-82a1a7fe-8b91-4e75-9b33-d276b539a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:25.779623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1a7fe-8b91-4e75-9b33-d276b539a898 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:25.851319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:25.851972 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:25.852251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:25.852522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:25.854149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:25.962832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:25.964329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ccfb-257b-4165-8647-45af7c31d3e4 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:25.983513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 666/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:28.323596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74be01-86bc-4521-b37e-a1cf1ce8735f None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:28.324158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74be01-86bc-4521-b37e-a1cf1ce8735f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:28.324158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74be01-86bc-4521-b37e-a1cf1ce8735f None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:28.325522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 669/1335] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:28.331270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c8cd-181a-4809-8743-92208d371c3f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:28.331690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c8cd-181a-4809-8743-92208d371c3f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:28.331827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c8cd-181a-4809-8743-92208d371c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:28.393761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9cc9c8cd-181a-4809-8743-92208d371c3f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:28.394932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9cc9c8cd-181a-4809-8743-92208d371c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:28.486206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 667/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:28.525157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74be01-86bc-4521-b37e-a1cf1ce8735f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:28.526667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-df74be01-86bc-4521-b37e-a1cf1ce8735f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:28.628207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74be01-86bc-4521-b37e-a1cf1ce8735f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:28.697767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:28.698404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:28.698682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:28.698952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:28.700595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:28.803649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:28.805085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0936f8-1961-4728-8c02-89f9e49780e2 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:28.822747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 670/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:34:31.425816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef30441-0135-4787-87b8-13de97646090 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:31.426336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef30441-0135-4787-87b8-13de97646090 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:31.426336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef30441-0135-4787-87b8-13de97646090 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:31.427759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 668/1338] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:31.432963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b2c6-b0a4-4a1c-9b5a-db5ad9bf5f27 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:31.433393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b2c6-b0a4-4a1c-9b5a-db5ad9bf5f27 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:31.433515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b2c6-b0a4-4a1c-9b5a-db5ad9bf5f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:31.497267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-57f6b2c6-b0a4-4a1c-9b5a-db5ad9bf5f27 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:31.498737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-57f6b2c6-b0a4-4a1c-9b5a-db5ad9bf5f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:31.591440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 671/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:34:31.626632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef30441-0135-4787-87b8-13de97646090 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:31.628184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2ef30441-0135-4787-87b8-13de97646090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:31.730623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef30441-0135-4787-87b8-13de97646090 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:31.799509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:31.800154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:31.800439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:31.800717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:31.802337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:31.906545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:31.908021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685630b1-8064-4093-bae2-5510f18a10b8 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:31.925084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 669/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:36.206141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359db8-f5d7-47fb-a640-e32379e10b69 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:36.206670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359db8-f5d7-47fb-a640-e32379e10b69 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:36.206670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359db8-f5d7-47fb-a640-e32379e10b69 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:36.207989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 672/1341] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:36.213297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395508a-693b-4446-9368-4e19ce720fc5 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:36.213711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395508a-693b-4446-9368-4e19ce720fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:36.213972 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395508a-693b-4446-9368-4e19ce720fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:36.282111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1395508a-693b-4446-9368-4e19ce720fc5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:36.283340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1395508a-693b-4446-9368-4e19ce720fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:36.380983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 670/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:36.421554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359db8-f5d7-47fb-a640-e32379e10b69 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:36.423734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-78359db8-f5d7-47fb-a640-e32379e10b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:36.517340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359db8-f5d7-47fb-a640-e32379e10b69 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:36.520899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b57c7-6338-4806-9d42-e7da29fba34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:36.521540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b57c7-6338-4806-9d42-e7da29fba34e service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:36.521827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b57c7-6338-4806-9d42-e7da29fba34e service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:36.522101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b57c7-6338-4806-9d42-e7da29fba34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:36.530934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b57c7-6338-4806-9d42-e7da29fba34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:36.532484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b57c7-6338-4806-9d42-e7da29fba34e service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:36.542111 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 673/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:39.369953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b6c6-58b2-431b-9148-eef20f471aa1 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:39.370579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b6c6-58b2-431b-9148-eef20f471aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:39.370579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b6c6-58b2-431b-9148-eef20f471aa1 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:39.371939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 671/1344] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:34:39.377710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e2a6-36b4-4259-b8ad-1f9074bd4a1d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:39.378145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e2a6-36b4-4259-b8ad-1f9074bd4a1d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:39.378271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e2a6-36b4-4259-b8ad-1f9074bd4a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:39.405613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-fd95e2a6-36b4-4259-b8ad-1f9074bd4a1d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:39.406827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fd95e2a6-36b4-4259-b8ad-1f9074bd4a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:39.488716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 674/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:39.529292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b6c6-58b2-431b-9148-eef20f471aa1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:39.539829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b6c6-58b2-431b-9148-eef20f471aa1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:39.543295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b7279-53bd-42f5-839e-0a01ced41427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:39.543940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b7279-53bd-42f5-839e-0a01ced41427 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:39.544248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b7279-53bd-42f5-839e-0a01ced41427 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:39.544520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b7279-53bd-42f5-839e-0a01ced41427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:39.553292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b7279-53bd-42f5-839e-0a01ced41427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:39.554703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b7279-53bd-42f5-839e-0a01ced41427 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:39.564395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 672/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:34:43.819517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12eaf-dd00-47d8-a2c3-369565072126 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:43.820011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12eaf-dd00-47d8-a2c3-369565072126 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:43.820011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12eaf-dd00-47d8-a2c3-369565072126 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:43.821362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 675/1347] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:43.826414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d61561-c7ab-4de3-b00b-72109781599d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:43.826809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d61561-c7ab-4de3-b00b-72109781599d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:43.826999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d61561-c7ab-4de3-b00b-72109781599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:43.845291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-86d61561-c7ab-4de3-b00b-72109781599d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:43.846483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-86d61561-c7ab-4de3-b00b-72109781599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:43.854307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 673/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:43.892181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12eaf-dd00-47d8-a2c3-369565072126 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:43.902572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12eaf-dd00-47d8-a2c3-369565072126 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:43.906022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928a55-cd16-44d4-ade8-d8fc97a2863f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:43.906654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928a55-cd16-44d4-ade8-d8fc97a2863f service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:43.906936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928a55-cd16-44d4-ade8-d8fc97a2863f service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:43.907246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928a55-cd16-44d4-ade8-d8fc97a2863f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:43.915877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928a55-cd16-44d4-ade8-d8fc97a2863f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:43.917310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928a55-cd16-44d4-ade8-d8fc97a2863f service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:43.926436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 676/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:34:49.251661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bf2ff-07f7-4f51-92ce-07b67feca039 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:49.252589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bf2ff-07f7-4f51-92ce-07b67feca039 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:49.253025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bf2ff-07f7-4f51-92ce-07b67feca039 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:49.254878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 674/1350] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:49.260275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7776f5-4ec7-438e-952d-ef7d18e97e88 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:49.260705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7776f5-4ec7-438e-952d-ef7d18e97e88 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:49.260831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7776f5-4ec7-438e-952d-ef7d18e97e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:49.420609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0f7776f5-4ec7-438e-952d-ef7d18e97e88 None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:49.422391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0f7776f5-4ec7-438e-952d-ef7d18e97e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:49.618140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 677/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:34:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:53.741427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17fb0-54d4-4f7f-9201-b72193a1a2f1 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:53.741946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17fb0-54d4-4f7f-9201-b72193a1a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:53.742161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17fb0-54d4-4f7f-9201-b72193a1a2f1 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:53.743966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 675/1352] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:34:53.749079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d39d-1450-4522-a83d-599c44af25aa None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:53.749534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d39d-1450-4522-a83d-599c44af25aa None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:53.750455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d39d-1450-4522-a83d-599c44af25aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:53.769792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-8f41d39d-1450-4522-a83d-599c44af25aa None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:53.771760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-8f41d39d-1450-4522-a83d-599c44af25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:53.782308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 678/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:55.250645 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310ea7-839a-421d-b362-fb3393cbf55f None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:55.251267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310ea7-839a-421d-b362-fb3393cbf55f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:55.251510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310ea7-839a-421d-b362-fb3393cbf55f None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:55.253315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 676/1354] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:55.258665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9312c44-8b71-44a9-a943-c8f2f4704ae9 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:55.259130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9312c44-8b71-44a9-a943-c8f2f4704ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:55.259415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9312c44-8b71-44a9-a943-c8f2f4704ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:55.278273 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c9312c44-8b71-44a9-a943-c8f2f4704ae9 None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:55.279488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c9312c44-8b71-44a9-a943-c8f2f4704ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:55.288232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 679/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:34:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:34:59.261196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad8c6-bef3-45b8-86b4-d148c0eba9ce None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:59.261738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad8c6-bef3-45b8-86b4-d148c0eba9ce None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:59.261738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad8c6-bef3-45b8-86b4-d148c0eba9ce None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:59.263485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 677/1356] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:59.268870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7971cf-198d-4c3e-8725-640d1dbfdcb4 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:59.269282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7971cf-198d-4c3e-8725-640d1dbfdcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:59.269439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7971cf-198d-4c3e-8725-640d1dbfdcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:59.288436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7a7971cf-198d-4c3e-8725-640d1dbfdcb4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:59.289623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7a7971cf-198d-4c3e-8725-640d1dbfdcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:59.298117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 680/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:59.346299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99bbba-5514-4932-9e91-db18bd9039a3 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:59.346588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99bbba-5514-4932-9e91-db18bd9039a3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:59.346865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99bbba-5514-4932-9e91-db18bd9039a3 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:59.348269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 678/1358] 10.222.0.45 () {54 vars in 960 bytes} [Fri Apr 29 18:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:34:59.353580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8478b9f-1b7f-4212-ae2e-1320026a8cd6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:59.353866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8478b9f-1b7f-4212-ae2e-1320026a8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:59.354142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8478b9f-1b7f-4212-ae2e-1320026a8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:59.402579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d8478b9f-1b7f-4212-ae2e-1320026a8cd6 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:34:59.404139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d8478b9f-1b7f-4212-ae2e-1320026a8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:34:59.493757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 681/1359] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Apr 29 18:34:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:34:59.502108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99bbba-5514-4932-9e91-db18bd9039a3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:34:59.521601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99bbba-5514-4932-9e91-db18bd9039a3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:34:59.529170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155313-cba2-4c35-9667-47cbe4a658d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:34:59.530097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155313-cba2-4c35-9667-47cbe4a658d2 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:34:59.530488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155313-cba2-4c35-9667-47cbe4a658d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:34:59.531530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155313-cba2-4c35-9667-47cbe4a658d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:34:59.540629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf155313-cba2-4c35-9667-47cbe4a658d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:34:59.542360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf155313-cba2-4c35-9667-47cbe4a658d2 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:34:59.552184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 679/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:02.002005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1e4ad-9963-4716-9657-1def26c64964 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:02.002516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1e4ad-9963-4716-9657-1def26c64964 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:02.002516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1e4ad-9963-4716-9657-1def26c64964 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:02.004014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 682/1361] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:02.008975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0d5f-6d37-4cdf-9291-b004b4311f0c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:02.009436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0d5f-6d37-4cdf-9291-b004b4311f0c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:02.009528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0d5f-6d37-4cdf-9291-b004b4311f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:02.027067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-a8fc0d5f-6d37-4cdf-9291-b004b4311f0c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:02.028269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-a8fc0d5f-6d37-4cdf-9291-b004b4311f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:02.039189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 680/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:02.083391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1e4ad-9963-4716-9657-1def26c64964 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:02.101750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1e4ad-9963-4716-9657-1def26c64964 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:02.110531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27af0-bdbd-48c6-9c42-ad30bd644033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:02.111613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27af0-bdbd-48c6-9c42-ad30bd644033 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:02.112125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27af0-bdbd-48c6-9c42-ad30bd644033 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:02.112629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27af0-bdbd-48c6-9c42-ad30bd644033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:02.122269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec27af0-bdbd-48c6-9c42-ad30bd644033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:02.123983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec27af0-bdbd-48c6-9c42-ad30bd644033 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:02.133676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 683/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:04.708084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4c88-adc8-475e-a062-355ce7a9a5df None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:04.708563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4c88-adc8-475e-a062-355ce7a9a5df None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:04.708563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4c88-adc8-475e-a062-355ce7a9a5df None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:04.709931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 681/1364] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:04.715242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e288cc-cb83-4431-893d-d2f729d38437 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:04.715646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e288cc-cb83-4431-893d-d2f729d38437 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:04.715738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e288cc-cb83-4431-893d-d2f729d38437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:04.734243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-41e288cc-cb83-4431-893d-d2f729d38437 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:04.735504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41e288cc-cb83-4431-893d-d2f729d38437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:04.743315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 684/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:35:04.788848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f43d-bbd1-4496-bed0-fbe6e9a67731 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:04.789204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f43d-bbd1-4496-bed0-fbe6e9a67731 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:04.790479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f43d-bbd1-4496-bed0-fbe6e9a67731 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:04.792406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 682/1366] 10.222.0.45 () {54 vars in 960 bytes} [Fri Apr 29 18:35:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:04.798080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43268421-b744-4b45-9295-364fb0b6e70f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:04.798615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43268421-b744-4b45-9295-364fb0b6e70f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:04.799146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43268421-b744-4b45-9295-364fb0b6e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:04.818999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-43268421-b744-4b45-9295-364fb0b6e70f None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:04.820257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-43268421-b744-4b45-9295-364fb0b6e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:04.830242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 685/1367] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Apr 29 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:04.837998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f43d-bbd1-4496-bed0-fbe6e9a67731 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:04.852382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f43d-bbd1-4496-bed0-fbe6e9a67731 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:04.857727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f75fa2-41b4-47d0-a4a0-1f3bfff56dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:04.858357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75fa2-41b4-47d0-a4a0-1f3bfff56dfc service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:04.858639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75fa2-41b4-47d0-a4a0-1f3bfff56dfc service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:04.858939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75fa2-41b4-47d0-a4a0-1f3bfff56dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:04.866715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f75fa2-41b4-47d0-a4a0-1f3bfff56dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:04.868307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f75fa2-41b4-47d0-a4a0-1f3bfff56dfc service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:04.878069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 683/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:07.244073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbf12-d559-44d5-b2b3-106066cb3e47 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.244612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbf12-d559-44d5-b2b3-106066cb3e47 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.244612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbf12-d559-44d5-b2b3-106066cb3e47 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.246042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 686/1369] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:07.252219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5562d-9694-401d-a0b2-e5860a146558 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.252755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5562d-9694-401d-a0b2-e5860a146558 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.252755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5562d-9694-401d-a0b2-e5860a146558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.272251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-def5562d-9694-401d-a0b2-e5860a146558 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:07.275167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-def5562d-9694-401d-a0b2-e5860a146558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:07.290651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 684/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:07.335225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bbf12-d559-44d5-b2b3-106066cb3e47 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:07.350314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bbf12-d559-44d5-b2b3-106066cb3e47 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:07.355942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e759a8-8e7c-4716-ade5-153a9d590699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:07.356698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e759a8-8e7c-4716-ade5-153a9d590699 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.357090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e759a8-8e7c-4716-ade5-153a9d590699 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.357473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e759a8-8e7c-4716-ade5-153a9d590699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.366621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e759a8-8e7c-4716-ade5-153a9d590699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:07.368412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e759a8-8e7c-4716-ade5-153a9d590699 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:07.378930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 687/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:07.431738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b91b4-1de2-4ac4-9e96-cc124914d649 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.432410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b91b4-1de2-4ac4-9e96-cc124914d649 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.433056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b91b4-1de2-4ac4-9e96-cc124914d649 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.435079 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 685/1372] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:07.441628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241dc3-3bc7-4ad8-aed0-7576115da234 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.441959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241dc3-3bc7-4ad8-aed0-7576115da234 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.443030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241dc3-3bc7-4ad8-aed0-7576115da234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.463705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-dd241dc3-3bc7-4ad8-aed0-7576115da234 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:07.466516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-dd241dc3-3bc7-4ad8-aed0-7576115da234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:07.476539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 688/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:35:07.764312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99241a-4b1e-41d0-a8e1-c7f80bbf670d None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.764748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99241a-4b1e-41d0-a8e1-c7f80bbf670d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.765669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99241a-4b1e-41d0-a8e1-c7f80bbf670d None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.767375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 686/1374] 10.222.0.45 () {54 vars in 962 bytes} [Fri Apr 29 18:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:07.772503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15cd2-e6a1-49ff-8ca6-21c26b7bc1b9 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.772915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15cd2-e6a1-49ff-8ca6-21c26b7bc1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.773303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15cd2-e6a1-49ff-8ca6-21c26b7bc1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.822264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f7c15cd2-e6a1-49ff-8ca6-21c26b7bc1b9 None None] MFA Rules not processed for user `0de2845217b943189e11f8a6549b1524`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:07.823646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f7c15cd2-e6a1-49ff-8ca6-21c26b7bc1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:07.885721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 689/1375] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Apr 29 18:35:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:07.894164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99241a-4b1e-41d0-a8e1-c7f80bbf670d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:07.904665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99241a-4b1e-41d0-a8e1-c7f80bbf670d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:07.908296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91814a2d-f799-4a8a-9317-39ee159103ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:07.909073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91814a2d-f799-4a8a-9317-39ee159103ff service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:07.909476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91814a2d-f799-4a8a-9317-39ee159103ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:07.909857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91814a2d-f799-4a8a-9317-39ee159103ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:07.919044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91814a2d-f799-4a8a-9317-39ee159103ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:07.920631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91814a2d-f799-4a8a-9317-39ee159103ff service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:07.930407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 687/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:09.662545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465acfc-1d79-4037-a20a-dcd495cb9a24 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:09.663165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465acfc-1d79-4037-a20a-dcd495cb9a24 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:09.663165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465acfc-1d79-4037-a20a-dcd495cb9a24 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:09.664676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 690/1377] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:09.669750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689f3a-8c0b-4947-a6e8-4744b25c7a75 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:09.670161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689f3a-8c0b-4947-a6e8-4744b25c7a75 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:09.670317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b689f3a-8c0b-4947-a6e8-4744b25c7a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:09.689498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5b689f3a-8c0b-4947-a6e8-4744b25c7a75 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:09.690974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5b689f3a-8c0b-4947-a6e8-4744b25c7a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:09.699131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 688/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:09.743533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465acfc-1d79-4037-a20a-dcd495cb9a24 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:09.758057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465acfc-1d79-4037-a20a-dcd495cb9a24 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:09.764647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0db92-8905-4396-9f1f-66ca6e652932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:09.765782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0db92-8905-4396-9f1f-66ca6e652932 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:09.766068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0db92-8905-4396-9f1f-66ca6e652932 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:09.766343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0db92-8905-4396-9f1f-66ca6e652932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:09.775994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0db92-8905-4396-9f1f-66ca6e652932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:09.778883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0db92-8905-4396-9f1f-66ca6e652932 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:09.792092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 691/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:12.096544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84fb8-c06a-412f-92ee-9a23da9eb1dd None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:12.097145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84fb8-c06a-412f-92ee-9a23da9eb1dd None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:12.097397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84fb8-c06a-412f-92ee-9a23da9eb1dd None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:12.099007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 689/1380] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:12.104182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0b68-59a8-4dc6-a56b-7713c6aa2162 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:12.104600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0b68-59a8-4dc6-a56b-7713c6aa2162 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:12.104731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0b68-59a8-4dc6-a56b-7713c6aa2162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:12.122575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-86fe0b68-59a8-4dc6-a56b-7713c6aa2162 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:12.123778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-86fe0b68-59a8-4dc6-a56b-7713c6aa2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:12.132309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 692/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:12.176016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba84fb8-c06a-412f-92ee-9a23da9eb1dd None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:12.190931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba84fb8-c06a-412f-92ee-9a23da9eb1dd None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:12.196320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a188-f596-4102-8eeb-badd189f90da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:12.197171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a188-f596-4102-8eeb-badd189f90da service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:12.197461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a188-f596-4102-8eeb-badd189f90da service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:12.197917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a188-f596-4102-8eeb-badd189f90da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:12.206425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a188-f596-4102-8eeb-badd189f90da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:12.208119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a188-f596-4102-8eeb-badd189f90da service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:12.217516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 690/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:14.492897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de96be-fd8b-4f51-a5f2-58e31090fda3 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:14.493458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de96be-fd8b-4f51-a5f2-58e31090fda3 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:14.493458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de96be-fd8b-4f51-a5f2-58e31090fda3 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:14.495088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 693/1383] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:14.500197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2da9b-428c-49d1-bc95-2c820d34b5cc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:14.500646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2da9b-428c-49d1-bc95-2c820d34b5cc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:14.500758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2da9b-428c-49d1-bc95-2c820d34b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:14.519980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-7ba2da9b-428c-49d1-bc95-2c820d34b5cc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:14.521169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7ba2da9b-428c-49d1-bc95-2c820d34b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:14.529220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 691/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:14.570131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de96be-fd8b-4f51-a5f2-58e31090fda3 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:14.584436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de96be-fd8b-4f51-a5f2-58e31090fda3 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:14.590143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f8e97-8ff2-4eee-a45b-7ce0792f71fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:14.590811 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8e97-8ff2-4eee-a45b-7ce0792f71fb service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:14.591092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8e97-8ff2-4eee-a45b-7ce0792f71fb service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:14.591407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8e97-8ff2-4eee-a45b-7ce0792f71fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:14.600319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f8e97-8ff2-4eee-a45b-7ce0792f71fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:14.601900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f8e97-8ff2-4eee-a45b-7ce0792f71fb service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:14.611427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 694/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:16.878826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7f24-878e-4b55-be5e-dbc49c2d98dc None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:16.879410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7f24-878e-4b55-be5e-dbc49c2d98dc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:16.879675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7f24-878e-4b55-be5e-dbc49c2d98dc None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:16.881633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 692/1386] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:16.887771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d5fc-e6d4-46cb-b8ec-df5d7b5fb574 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:16.888189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d5fc-e6d4-46cb-b8ec-df5d7b5fb574 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:16.888329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d5fc-e6d4-46cb-b8ec-df5d7b5fb574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:16.906571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-1238d5fc-e6d4-46cb-b8ec-df5d7b5fb574 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:16.907814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1238d5fc-e6d4-46cb-b8ec-df5d7b5fb574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:16.915549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 695/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:16.961274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7f24-878e-4b55-be5e-dbc49c2d98dc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:16.976257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7f24-878e-4b55-be5e-dbc49c2d98dc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:16.981587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d47276-e5cf-450d-8ff3-1790d1ec7809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:16.982299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d47276-e5cf-450d-8ff3-1790d1ec7809 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:16.982575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d47276-e5cf-450d-8ff3-1790d1ec7809 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:16.982797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d47276-e5cf-450d-8ff3-1790d1ec7809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:16.990953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d47276-e5cf-450d-8ff3-1790d1ec7809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:16.992563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d47276-e5cf-450d-8ff3-1790d1ec7809 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:17.002738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 693/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:19.249763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fda07-80d5-4655-98a9-d51d4b7ffb51 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:19.250654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fda07-80d5-4655-98a9-d51d4b7ffb51 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:19.250939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fda07-80d5-4655-98a9-d51d4b7ffb51 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:19.252429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 696/1389] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:19.258070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a76a-a5b1-4049-b88f-aeb0b3d3ec80 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:19.258500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a76a-a5b1-4049-b88f-aeb0b3d3ec80 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:19.258803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a76a-a5b1-4049-b88f-aeb0b3d3ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:19.281897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-56e9a76a-a5b1-4049-b88f-aeb0b3d3ec80 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:19.283799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-56e9a76a-a5b1-4049-b88f-aeb0b3d3ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:19.294097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 694/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:19.337374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fda07-80d5-4655-98a9-d51d4b7ffb51 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:19.352051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fda07-80d5-4655-98a9-d51d4b7ffb51 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:19.357418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5b147-d96f-4abc-b85a-919c5c08767a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:19.358046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5b147-d96f-4abc-b85a-919c5c08767a service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:19.358329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5b147-d96f-4abc-b85a-919c5c08767a service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:19.358685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5b147-d96f-4abc-b85a-919c5c08767a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:19.366486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5b147-d96f-4abc-b85a-919c5c08767a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:19.368087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5b147-d96f-4abc-b85a-919c5c08767a service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:19.377629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 697/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:21.945243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e600-b9c1-4289-b944-f6d9ea574214 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:21.945859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e600-b9c1-4289-b944-f6d9ea574214 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:21.945859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8e600-b9c1-4289-b944-f6d9ea574214 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:21.947235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 695/1392] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:21.953391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0313f-e864-44a9-8818-aeabd326c782 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:21.953873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0313f-e864-44a9-8818-aeabd326c782 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:21.953980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0313f-e864-44a9-8818-aeabd326c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:21.972790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a9c0313f-e864-44a9-8818-aeabd326c782 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:21.973976 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a9c0313f-e864-44a9-8818-aeabd326c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:21.981804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 698/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:22.025657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8e600-b9c1-4289-b944-f6d9ea574214 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:22.040199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8e600-b9c1-4289-b944-f6d9ea574214 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:22.045684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0dba4-e3d6-4d91-a855-437d78870f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:22.046329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0dba4-e3d6-4d91-a855-437d78870f93 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:22.046616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0dba4-e3d6-4d91-a855-437d78870f93 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:22.046896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0dba4-e3d6-4d91-a855-437d78870f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:22.055022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0dba4-e3d6-4d91-a855-437d78870f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:22.056617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0dba4-e3d6-4d91-a855-437d78870f93 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:22.065827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 696/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:23.730430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9658fe-4983-4621-b225-2c05a72e7cd7 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:23.730971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9658fe-4983-4621-b225-2c05a72e7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:23.730971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9658fe-4983-4621-b225-2c05a72e7cd7 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:23.732356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 699/1395] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:23.737693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbae7c5-0b60-4065-a832-7c2c959c3f20 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:23.738100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbae7c5-0b60-4065-a832-7c2c959c3f20 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:23.738252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbae7c5-0b60-4065-a832-7c2c959c3f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:23.756891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-7bbae7c5-0b60-4065-a832-7c2c959c3f20 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:23.758096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7bbae7c5-0b60-4065-a832-7c2c959c3f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:23.766680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 697/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:23.821855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ecf83-ff3e-4133-948f-7b6c9a18982c None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:23.822137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ecf83-ff3e-4133-948f-7b6c9a18982c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:23.822410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ecf83-ff3e-4133-948f-7b6c9a18982c None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:23.823792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 700/1397] 10.222.0.45 () {54 vars in 962 bytes} [Fri Apr 29 18:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:23.829184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dae88-2c07-4f5a-b978-fec9d23c4483 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:23.829467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dae88-2c07-4f5a-b978-fec9d23c4483 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:23.829738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dae88-2c07-4f5a-b978-fec9d23c4483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:23.877640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-396dae88-2c07-4f5a-b978-fec9d23c4483 None None] MFA Rules not processed for user `cef8f88990984c38945657983e4111f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:23.878842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-396dae88-2c07-4f5a-b978-fec9d23c4483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:23.935769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 698/1398] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Apr 29 18:35:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:23.943706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ecf83-ff3e-4133-948f-7b6c9a18982c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:23.954860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ecf83-ff3e-4133-948f-7b6c9a18982c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:23.958490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf6421-878f-41d9-afc1-2bd2a33bf212 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:23.959150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf6421-878f-41d9-afc1-2bd2a33bf212 service glance] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:23.959438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf6421-878f-41d9-afc1-2bd2a33bf212 service glance] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:23.959713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf6421-878f-41d9-afc1-2bd2a33bf212 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:23.968574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf6421-878f-41d9-afc1-2bd2a33bf212 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:23.969997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf6421-878f-41d9-afc1-2bd2a33bf212 service glance] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:23.979458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 701/1399] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:24.336982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa12f16-ae36-4f04-a762-860620de81c5 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.337270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa12f16-ae36-4f04-a762-860620de81c5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.337571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa12f16-ae36-4f04-a762-860620de81c5 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.338980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 699/1400] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:24.344191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.344511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.344795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.362850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:24.364083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:24.372041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 702/1401] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:24.398352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd7e-4b55-4a3b-99a9-27eb3fce7805 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.398648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd7e-4b55-4a3b-99a9-27eb3fce7805 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.398933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd7e-4b55-4a3b-99a9-27eb3fce7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.416122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:24.428475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d6a39-49d6-4d25-b2f8-a2975014c5ad None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:24.433780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fcbff-4ea3-4cc1-8bca-c26da365c157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:24.434585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fcbff-4ea3-4cc1-8bca-c26da365c157 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.434878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fcbff-4ea3-4cc1-8bca-c26da365c157 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.435183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fcbff-4ea3-4cc1-8bca-c26da365c157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.443518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fcbff-4ea3-4cc1-8bca-c26da365c157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:24.445138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fcbff-4ea3-4cc1-8bca-c26da365c157 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:24.448496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-96b7fd7e-4b55-4a3b-99a9-27eb3fce7805 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:24.449680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-96b7fd7e-4b55-4a3b-99a9-27eb3fce7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:24.454630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 703/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:35:24.514827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 700/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:35:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:24.564185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0da70-6e13-46d7-9e5d-00a9be7a3a44 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.564479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0da70-6e13-46d7-9e5d-00a9be7a3a44 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.564760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0da70-6e13-46d7-9e5d-00a9be7a3a44 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.566201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 704/1404] 10.222.0.45 () {54 vars in 942 bytes} [Fri Apr 29 18:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:24.573235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af63128-f854-4486-86c0-e89243935f57 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.573526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af63128-f854-4486-86c0-e89243935f57 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.573806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af63128-f854-4486-86c0-e89243935f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.626548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8af63128-f854-4486-86c0-e89243935f57 None None] MFA Rules not processed for user `8e60e2dfa5814b699d107aa74f55c59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:24.627964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8af63128-f854-4486-86c0-e89243935f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:24.701604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 701/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Fri Apr 29 18:35:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:24.711177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0da70-6e13-46d7-9e5d-00a9be7a3a44 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:24.724902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0da70-6e13-46d7-9e5d-00a9be7a3a44 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:24.729816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5d1d-257e-4777-b8d9-41bce08c6b11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:24.730556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5d1d-257e-4777-b8d9-41bce08c6b11 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:24.731140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5d1d-257e-4777-b8d9-41bce08c6b11 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:24.731248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5d1d-257e-4777-b8d9-41bce08c6b11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:24.739850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5d1d-257e-4777-b8d9-41bce08c6b11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:24.741513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5d1d-257e-4777-b8d9-41bce08c6b11 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:24.749687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 705/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:35:26.736564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984e14-2f73-4f2a-8d37-f8a2c10e790b None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:26.737438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984e14-2f73-4f2a-8d37-f8a2c10e790b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:26.737438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984e14-2f73-4f2a-8d37-f8a2c10e790b None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:26.744176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d0684-0103-415c-b8f3-000b70ef2914 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:26.745013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d0684-0103-415c-b8f3-000b70ef2914 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:26.745539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d0684-0103-415c-b8f3-000b70ef2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:26.747559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 702/1407] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:35:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:26.775682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-071d0684-0103-415c-b8f3-000b70ef2914 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:26.778300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-071d0684-0103-415c-b8f3-000b70ef2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:26.812516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 706/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:26.846848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f984e14-2f73-4f2a-8d37-f8a2c10e790b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:26.861815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f984e14-2f73-4f2a-8d37-f8a2c10e790b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:26.868659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406cc65-2946-456f-8159-d6c10cd9f72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:26.869470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406cc65-2946-456f-8159-d6c10cd9f72a service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:26.871899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406cc65-2946-456f-8159-d6c10cd9f72a service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:26.871899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406cc65-2946-456f-8159-d6c10cd9f72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:26.882556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406cc65-2946-456f-8159-d6c10cd9f72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:26.884343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406cc65-2946-456f-8159-d6c10cd9f72a service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:26.895600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 703/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:47.950676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ad120-e670-43d2-b4b1-2ee00d86789f None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:47.951388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ad120-e670-43d2-b4b1-2ee00d86789f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:47.951388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ad120-e670-43d2-b4b1-2ee00d86789f None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:47.952667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 707/1410] 10.222.0.45 () {54 vars in 918 bytes} [Fri Apr 29 18:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:47.958050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaaa22-4d26-4f0b-a5bd-6c1456301ea1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:47.958533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaaa22-4d26-4f0b-a5bd-6c1456301ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:47.958654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaaa22-4d26-4f0b-a5bd-6c1456301ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:47.976691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2efaaa22-4d26-4f0b-a5bd-6c1456301ea1 None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:47.977872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2efaaa22-4d26-4f0b-a5bd-6c1456301ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:47.986991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 704/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Apr 29 18:35:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:48.000915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767deeb-a551-4245-83fc-ef21dd1c78ba None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:48.001209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767deeb-a551-4245-83fc-ef21dd1c78ba None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:48.001493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767deeb-a551-4245-83fc-ef21dd1c78ba None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:48.002856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 708/1412] 10.222.0.45 () {54 vars in 918 bytes} [Fri Apr 29 18:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:48.007417 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13fca-af8a-4cf8-81cb-ab16a370b171 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:48.007706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13fca-af8a-4cf8-81cb-ab16a370b171 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:48.007982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13fca-af8a-4cf8-81cb-ab16a370b171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:48.025767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-40e13fca-af8a-4cf8-81cb-ab16a370b171 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:48.026914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-40e13fca-af8a-4cf8-81cb-ab16a370b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:48.036522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 705/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Apr 29 18:35:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:35:50.786921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf576717-9dbf-48c8-b382-d2df3dfb8c63 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:50.787485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf576717-9dbf-48c8-b382-d2df3dfb8c63 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:50.787485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf576717-9dbf-48c8-b382-d2df3dfb8c63 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:50.788771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:50.794064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36942a-aca4-4acf-9d46-d47b5bedbc9d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:50.794511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36942a-aca4-4acf-9d46-d47b5bedbc9d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:50.794619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36942a-aca4-4acf-9d46-d47b5bedbc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:50.813372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6e36942a-aca4-4acf-9d46-d47b5bedbc9d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:50.814563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6e36942a-aca4-4acf-9d46-d47b5bedbc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:50.822257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:50.863778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf576717-9dbf-48c8-b382-d2df3dfb8c63 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:50.877723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf576717-9dbf-48c8-b382-d2df3dfb8c63 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:50.883055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbbe31-693e-4f75-a414-457a97b8a4ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:50.883718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe31-693e-4f75-a414-457a97b8a4ba service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:50.884003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe31-693e-4f75-a414-457a97b8a4ba service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:50.884282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe31-693e-4f75-a414-457a97b8a4ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:50.892401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbbe31-693e-4f75-a414-457a97b8a4ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:50.893988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbbe31-693e-4f75-a414-457a97b8a4ba service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:50.903036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 710/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:52.211263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eefab0-153f-44c4-8b7a-a08aba973b3e None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:52.211841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eefab0-153f-44c4-8b7a-a08aba973b3e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:52.211841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eefab0-153f-44c4-8b7a-a08aba973b3e None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:52.213196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:52.218018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efab72-18f0-4c4b-a7a5-698688023e80 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:52.218480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efab72-18f0-4c4b-a7a5-698688023e80 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:52.218586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efab72-18f0-4c4b-a7a5-698688023e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:52.235943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-15efab72-18f0-4c4b-a7a5-698688023e80 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:52.237131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-15efab72-18f0-4c4b-a7a5-698688023e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:52.244839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:52.410584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eefab0-153f-44c4-8b7a-a08aba973b3e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:52.424571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eefab0-153f-44c4-8b7a-a08aba973b3e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:52.429846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6ed7d-f66c-41c5-83d6-6a4983f98a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:52.430478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ed7d-f66c-41c5-83d6-6a4983f98a30 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:52.430760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ed7d-f66c-41c5-83d6-6a4983f98a30 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:52.431033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6ed7d-f66c-41c5-83d6-6a4983f98a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:52.439429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6ed7d-f66c-41c5-83d6-6a4983f98a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:52.441003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6ed7d-f66c-41c5-83d6-6a4983f98a30 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:52.450584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 708/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:53.708248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d22b-3991-4397-8dba-75ab8c31cb62 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:53.708809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d22b-3991-4397-8dba-75ab8c31cb62 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:53.708809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d22b-3991-4397-8dba-75ab8c31cb62 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:53.710188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:53.715267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf90b-be55-4b3d-ab1a-bb3804c5ee93 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:53.715671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf90b-be55-4b3d-ab1a-bb3804c5ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:53.715764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf90b-be55-4b3d-ab1a-bb3804c5ee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:53.732952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-07ecf90b-be55-4b3d-ab1a-bb3804c5ee93 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:53.734127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-07ecf90b-be55-4b3d-ab1a-bb3804c5ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:53.741760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:53.890894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d22b-3991-4397-8dba-75ab8c31cb62 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:53.905038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d22b-3991-4397-8dba-75ab8c31cb62 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:53.910361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcbdfe-e105-4bd2-a8c8-ef1edb024e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:53.911024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcbdfe-e105-4bd2-a8c8-ef1edb024e07 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:53.911337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcbdfe-e105-4bd2-a8c8-ef1edb024e07 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:53.911641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcbdfe-e105-4bd2-a8c8-ef1edb024e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:53.919535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcbdfe-e105-4bd2-a8c8-ef1edb024e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:53.921117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcbdfe-e105-4bd2-a8c8-ef1edb024e07 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:53.930170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 713/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:55.176990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d882-3bbb-44b9-b29c-24d5dfc71c57 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:55.177399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d882-3bbb-44b9-b29c-24d5dfc71c57 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:55.177545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d882-3bbb-44b9-b29c-24d5dfc71c57 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:55.179142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:55.184262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72b17-8c14-4a7e-bdf5-50c0dce3449f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:55.184675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72b17-8c14-4a7e-bdf5-50c0dce3449f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:55.184822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72b17-8c14-4a7e-bdf5-50c0dce3449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:55.203149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a1a72b17-8c14-4a7e-bdf5-50c0dce3449f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:55.204657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a1a72b17-8c14-4a7e-bdf5-50c0dce3449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:55.212407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:55.368190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d882-3bbb-44b9-b29c-24d5dfc71c57 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:55.382580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d882-3bbb-44b9-b29c-24d5dfc71c57 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:55.388191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f8eb1-da0e-481b-a37d-5692217000f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:55.389474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f8eb1-da0e-481b-a37d-5692217000f0 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:55.389757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f8eb1-da0e-481b-a37d-5692217000f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:55.390033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f8eb1-da0e-481b-a37d-5692217000f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:55.397930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f8eb1-da0e-481b-a37d-5692217000f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:55.399530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f8eb1-da0e-481b-a37d-5692217000f0 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:55.408575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 711/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:56.682036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65cfa5-69fd-4deb-9b45-fc94a2623e79 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:56.682656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65cfa5-69fd-4deb-9b45-fc94a2623e79 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:56.682656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65cfa5-69fd-4deb-9b45-fc94a2623e79 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:56.683995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:56.689294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d439-e79d-4889-b6a2-c73b91420897 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:56.689703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d439-e79d-4889-b6a2-c73b91420897 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:56.689856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2d439-e79d-4889-b6a2-c73b91420897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:56.707726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-99a2d439-e79d-4889-b6a2-c73b91420897 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:56.708917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-99a2d439-e79d-4889-b6a2-c73b91420897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:56.716614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:56.863136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65cfa5-69fd-4deb-9b45-fc94a2623e79 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:56.877445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65cfa5-69fd-4deb-9b45-fc94a2623e79 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:56.882677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb5239-e6b6-4343-b8c5-d26b30c309ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:56.883332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5239-e6b6-4343-b8c5-d26b30c309ce service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:56.883614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5239-e6b6-4343-b8c5-d26b30c309ce service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:56.883888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5239-e6b6-4343-b8c5-d26b30c309ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:56.892504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb5239-e6b6-4343-b8c5-d26b30c309ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:56.894074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb5239-e6b6-4343-b8c5-d26b30c309ce service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:56.903062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 716/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:58.108395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0a0e-25c2-4206-84a3-9005c76c8c3a None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:58.108976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0a0e-25c2-4206-84a3-9005c76c8c3a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:58.108976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0a0e-25c2-4206-84a3-9005c76c8c3a None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:58.110331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:58.115358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91df82-ada8-48a8-aea4-9aa61cf5aaf9 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:58.115767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91df82-ada8-48a8-aea4-9aa61cf5aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:58.115964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91df82-ada8-48a8-aea4-9aa61cf5aaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:58.133676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0a91df82-ada8-48a8-aea4-9aa61cf5aaf9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:58.134855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0a91df82-ada8-48a8-aea4-9aa61cf5aaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:58.143383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:35:58.289037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff0a0e-25c2-4206-84a3-9005c76c8c3a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:58.303343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff0a0e-25c2-4206-84a3-9005c76c8c3a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:58.308670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61760-8724-48ca-8c94-8b5447cd3da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:58.309314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61760-8724-48ca-8c94-8b5447cd3da2 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:58.309599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61760-8724-48ca-8c94-8b5447cd3da2 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:58.309879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61760-8724-48ca-8c94-8b5447cd3da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:58.318315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c61760-8724-48ca-8c94-8b5447cd3da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:58.319930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c61760-8724-48ca-8c94-8b5447cd3da2 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:58.329627 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 714/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:35:59.502370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060cf14-16ff-4ec2-9ddd-0e73848d108b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:59.502928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060cf14-16ff-4ec2-9ddd-0e73848d108b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:59.502928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060cf14-16ff-4ec2-9ddd-0e73848d108b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:59.504306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:35:59.509268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626cf2-94d7-4e98-803d-36ad303022ec None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:59.509674 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626cf2-94d7-4e98-803d-36ad303022ec None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:59.509880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626cf2-94d7-4e98-803d-36ad303022ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:59.528335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0b626cf2-94d7-4e98-803d-36ad303022ec None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:35:59.529532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0b626cf2-94d7-4e98-803d-36ad303022ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:35:59.537823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:35:59.685478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060cf14-16ff-4ec2-9ddd-0e73848d108b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:35:59.699740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060cf14-16ff-4ec2-9ddd-0e73848d108b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:35:59.705585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33434e0b-26e1-4dd3-9e4c-14eab68699b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:35:59.706209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33434e0b-26e1-4dd3-9e4c-14eab68699b9 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:35:59.706491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33434e0b-26e1-4dd3-9e4c-14eab68699b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:35:59.706766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33434e0b-26e1-4dd3-9e4c-14eab68699b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:35:59.714536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33434e0b-26e1-4dd3-9e4c-14eab68699b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:35:59.716068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33434e0b-26e1-4dd3-9e4c-14eab68699b9 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:35:59.724948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 719/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:00.902219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fed6fe-e4e7-4ff7-b0ba-2247c280bec5 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:00.902773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fed6fe-e4e7-4ff7-b0ba-2247c280bec5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:00.902773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fed6fe-e4e7-4ff7-b0ba-2247c280bec5 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:00.904161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:00.909633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbcf0-3aea-4182-ac7e-9c3bb106cd82 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:00.910081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbcf0-3aea-4182-ac7e-9c3bb106cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:00.910191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbcf0-3aea-4182-ac7e-9c3bb106cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:00.927694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-233bbcf0-3aea-4182-ac7e-9c3bb106cd82 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:00.928882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-233bbcf0-3aea-4182-ac7e-9c3bb106cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:00.936502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:01.083914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fed6fe-e4e7-4ff7-b0ba-2247c280bec5 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:01.098377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fed6fe-e4e7-4ff7-b0ba-2247c280bec5 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:01.103752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbef23-2ad3-4f62-803e-7b08d3a75dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:01.104395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbef23-2ad3-4f62-803e-7b08d3a75dae service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:01.104683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbef23-2ad3-4f62-803e-7b08d3a75dae service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:01.104964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbef23-2ad3-4f62-803e-7b08d3a75dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:01.112799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbef23-2ad3-4f62-803e-7b08d3a75dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:01.114411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbef23-2ad3-4f62-803e-7b08d3a75dae service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:01.123604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 717/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:02.299747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f56d-5ff5-4a0c-8961-ed469d3432fb None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:02.300313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f56d-5ff5-4a0c-8961-ed469d3432fb None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:02.300313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f56d-5ff5-4a0c-8961-ed469d3432fb None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:02.301652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:02.306465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20e6a-5d7e-41cd-a1ed-c59a46832eb3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:02.306855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20e6a-5d7e-41cd-a1ed-c59a46832eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:02.307041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20e6a-5d7e-41cd-a1ed-c59a46832eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:02.324559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d1e20e6a-5d7e-41cd-a1ed-c59a46832eb3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:02.325758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d1e20e6a-5d7e-41cd-a1ed-c59a46832eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:02.333987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:02.485766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3f56d-5ff5-4a0c-8961-ed469d3432fb None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:02.499929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3f56d-5ff5-4a0c-8961-ed469d3432fb None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:02.505300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c72f-aaf1-4f3a-9719-eeb55f000baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:02.505953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c72f-aaf1-4f3a-9719-eeb55f000baf service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:02.506221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c72f-aaf1-4f3a-9719-eeb55f000baf service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:02.506502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c72f-aaf1-4f3a-9719-eeb55f000baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:02.515131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c72f-aaf1-4f3a-9719-eeb55f000baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:02.516742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c72f-aaf1-4f3a-9719-eeb55f000baf service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:02.525855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 722/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:04.642422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93f022-1ec8-4dd4-b5b8-dd94137df8de None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:04.642955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93f022-1ec8-4dd4-b5b8-dd94137df8de None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:04.642955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93f022-1ec8-4dd4-b5b8-dd94137df8de None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:04.644381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:04.649625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19505f9b-f4ca-4a4b-8157-774b01253fb4 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:04.650054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19505f9b-f4ca-4a4b-8157-774b01253fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:04.650208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19505f9b-f4ca-4a4b-8157-774b01253fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:04.668009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-19505f9b-f4ca-4a4b-8157-774b01253fb4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:04.669186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-19505f9b-f4ca-4a4b-8157-774b01253fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:04.677187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:04.714967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93f022-1ec8-4dd4-b5b8-dd94137df8de None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:04.726093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93f022-1ec8-4dd4-b5b8-dd94137df8de None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:04.729599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e3ef5-e6cf-44f8-92e2-fa97d6ea03f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:04.730234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e3ef5-e6cf-44f8-92e2-fa97d6ea03f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:04.730518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e3ef5-e6cf-44f8-92e2-fa97d6ea03f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:04.730792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e3ef5-e6cf-44f8-92e2-fa97d6ea03f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:04.739592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e3ef5-e6cf-44f8-92e2-fa97d6ea03f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:04.741006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e3ef5-e6cf-44f8-92e2-fa97d6ea03f2 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:04.750278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 720/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:07.111621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f88ca-5d95-47e2-af7c-dbb25e03906c None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:07.112201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f88ca-5d95-47e2-af7c-dbb25e03906c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:07.112201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f88ca-5d95-47e2-af7c-dbb25e03906c None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:07.113518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:07.118868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cf2fc-da30-463d-8ed5-7a482c7885fd None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:07.119308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cf2fc-da30-463d-8ed5-7a482c7885fd None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:07.119458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cf2fc-da30-463d-8ed5-7a482c7885fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:07.137088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-560cf2fc-da30-463d-8ed5-7a482c7885fd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:07.138513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-560cf2fc-da30-463d-8ed5-7a482c7885fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:07.146728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:07.184110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f88ca-5d95-47e2-af7c-dbb25e03906c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:07.185855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-855f88ca-5d95-47e2-af7c-dbb25e03906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:07.199005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f88ca-5d95-47e2-af7c-dbb25e03906c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:07.203255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2579ea-3333-4506-9d5d-4be4215b82a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:07.203912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2579ea-3333-4506-9d5d-4be4215b82a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:07.204195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2579ea-3333-4506-9d5d-4be4215b82a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:07.204496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2579ea-3333-4506-9d5d-4be4215b82a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:07.213164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2579ea-3333-4506-9d5d-4be4215b82a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:07.214584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2579ea-3333-4506-9d5d-4be4215b82a8 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:07.223637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 725/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:09.754343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94185-078a-4d14-8d6d-cea8b11a91b7 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:09.754906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94185-078a-4d14-8d6d-cea8b11a91b7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:09.754906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94185-078a-4d14-8d6d-cea8b11a91b7 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:09.756206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:09.761619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cce07-c7c4-4987-b945-a08a77fbe818 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:09.762088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cce07-c7c4-4987-b945-a08a77fbe818 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:09.762190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cce07-c7c4-4987-b945-a08a77fbe818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:09.780770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-620cce07-c7c4-4987-b945-a08a77fbe818 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:09.781950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-620cce07-c7c4-4987-b945-a08a77fbe818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:09.789762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:36:09.828167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94185-078a-4d14-8d6d-cea8b11a91b7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:09.838782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94185-078a-4d14-8d6d-cea8b11a91b7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:09.842407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872760-2e38-4a91-8802-aa2d3876c996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:09.843658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872760-2e38-4a91-8802-aa2d3876c996 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:09.843958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872760-2e38-4a91-8802-aa2d3876c996 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:09.844216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872760-2e38-4a91-8802-aa2d3876c996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:09.852807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872760-2e38-4a91-8802-aa2d3876c996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:09.854226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872760-2e38-4a91-8802-aa2d3876c996 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:09.863679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 723/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:12.195037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991c35-7bfe-4b05-bfd2-883a1e017f0c None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:12.195638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991c35-7bfe-4b05-bfd2-883a1e017f0c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:12.195638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a991c35-7bfe-4b05-bfd2-883a1e017f0c None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:12.196969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:12.202341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ac1ea-474e-4dc6-a801-1bafcb670aeb None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:12.202750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ac1ea-474e-4dc6-a801-1bafcb670aeb None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:12.202923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ac1ea-474e-4dc6-a801-1bafcb670aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:12.219990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-586ac1ea-474e-4dc6-a801-1bafcb670aeb None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:12.221198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-586ac1ea-474e-4dc6-a801-1bafcb670aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:12.228871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:12.266885 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a991c35-7bfe-4b05-bfd2-883a1e017f0c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:12.277341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a991c35-7bfe-4b05-bfd2-883a1e017f0c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:12.280819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26159af3-8159-4466-a6fc-eaaf714e9564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:12.281475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26159af3-8159-4466-a6fc-eaaf714e9564 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:12.281755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26159af3-8159-4466-a6fc-eaaf714e9564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:12.282029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26159af3-8159-4466-a6fc-eaaf714e9564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:12.290638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26159af3-8159-4466-a6fc-eaaf714e9564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:12.292121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26159af3-8159-4466-a6fc-eaaf714e9564 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:12.301759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 728/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:14.573842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68694e9c-0fc5-4652-abed-3ec8a311ca84 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:14.574392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68694e9c-0fc5-4652-abed-3ec8a311ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:14.574392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68694e9c-0fc5-4652-abed-3ec8a311ca84 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:14.575830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:14.581386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e935af-c226-4aa1-882c-a07d20b49bc4 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:14.581781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e935af-c226-4aa1-882c-a07d20b49bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:14.581937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e935af-c226-4aa1-882c-a07d20b49bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:14.599399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-43e935af-c226-4aa1-882c-a07d20b49bc4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:14.600569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-43e935af-c226-4aa1-882c-a07d20b49bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:14.608208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:14.645773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68694e9c-0fc5-4652-abed-3ec8a311ca84 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:14.656347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68694e9c-0fc5-4652-abed-3ec8a311ca84 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:14.659861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dabc9b-ac02-4e67-a231-0da74a53211b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:14.660498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dabc9b-ac02-4e67-a231-0da74a53211b service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:14.660782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dabc9b-ac02-4e67-a231-0da74a53211b service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:14.661061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dabc9b-ac02-4e67-a231-0da74a53211b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:14.669675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dabc9b-ac02-4e67-a231-0da74a53211b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:14.671409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dabc9b-ac02-4e67-a231-0da74a53211b service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:14.681327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 726/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:16.998170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc236b19-54eb-4925-8758-b252a8a678a9 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:16.998740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc236b19-54eb-4925-8758-b252a8a678a9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:16.998740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc236b19-54eb-4925-8758-b252a8a678a9 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:17.000152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:17.005253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e82a-ba4c-4f6e-8904-03ab605b4c2d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:17.005697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e82a-ba4c-4f6e-8904-03ab605b4c2d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:17.005825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e82a-ba4c-4f6e-8904-03ab605b4c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:17.023333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0ee5e82a-ba4c-4f6e-8904-03ab605b4c2d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:17.024518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0ee5e82a-ba4c-4f6e-8904-03ab605b4c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:17.032817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:17.070426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc236b19-54eb-4925-8758-b252a8a678a9 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:17.081070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc236b19-54eb-4925-8758-b252a8a678a9 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:17.084659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd860917-6d80-42b3-947e-f635eb8b9999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:17.085289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860917-6d80-42b3-947e-f635eb8b9999 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:17.085572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860917-6d80-42b3-947e-f635eb8b9999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:17.085852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd860917-6d80-42b3-947e-f635eb8b9999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:17.094981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd860917-6d80-42b3-947e-f635eb8b9999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:17.096446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd860917-6d80-42b3-947e-f635eb8b9999 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:17.105598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 731/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:19.372614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a107afe-febe-44f5-88a3-105472b79dbc None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:19.373211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a107afe-febe-44f5-88a3-105472b79dbc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:19.373211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a107afe-febe-44f5-88a3-105472b79dbc None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:19.375128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:19.380939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0073de-731d-4b00-bfc5-6430b250b1a6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:19.381405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0073de-731d-4b00-bfc5-6430b250b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:19.381529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0073de-731d-4b00-bfc5-6430b250b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:19.400999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ea0073de-731d-4b00-bfc5-6430b250b1a6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:19.402207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ea0073de-731d-4b00-bfc5-6430b250b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:19.409961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:19.446275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a107afe-febe-44f5-88a3-105472b79dbc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:19.457296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a107afe-febe-44f5-88a3-105472b79dbc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:19.460921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721b683-7a0b-43aa-91d3-47030dab0dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:19.461560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b683-7a0b-43aa-91d3-47030dab0dfb service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:19.461843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b683-7a0b-43aa-91d3-47030dab0dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:19.462119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b683-7a0b-43aa-91d3-47030dab0dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:19.470905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721b683-7a0b-43aa-91d3-47030dab0dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:19.472365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721b683-7a0b-43aa-91d3-47030dab0dfb service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:19.481485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 729/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:21.729785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84096-9642-469b-a1c8-ccfe411920c1 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:21.730317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84096-9642-469b-a1c8-ccfe411920c1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:21.730317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84096-9642-469b-a1c8-ccfe411920c1 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:21.731655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:21.736881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6295f-1183-466a-8cf1-cb151e01ac99 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:21.737299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6295f-1183-466a-8cf1-cb151e01ac99 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:21.737441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6295f-1183-466a-8cf1-cb151e01ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:21.754632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f9b6295f-1183-466a-8cf1-cb151e01ac99 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:21.755851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f9b6295f-1183-466a-8cf1-cb151e01ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:21.763983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:21.800967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84096-9642-469b-a1c8-ccfe411920c1 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:21.811326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84096-9642-469b-a1c8-ccfe411920c1 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:21.814730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98032ef8-bee4-4cef-b6e3-2bca964c4c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:21.815380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98032ef8-bee4-4cef-b6e3-2bca964c4c19 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:21.815667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98032ef8-bee4-4cef-b6e3-2bca964c4c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:21.815938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98032ef8-bee4-4cef-b6e3-2bca964c4c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:21.824350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98032ef8-bee4-4cef-b6e3-2bca964c4c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:21.825805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98032ef8-bee4-4cef-b6e3-2bca964c4c19 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:21.835260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 734/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:24.136637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eebf-8507-4215-9c02-a5637f5874d0 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:24.137228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eebf-8507-4215-9c02-a5637f5874d0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:24.137228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eebf-8507-4215-9c02-a5637f5874d0 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:24.138803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:24.143978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee03c2-81ee-4d43-a141-6132f53d331a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:24.144428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee03c2-81ee-4d43-a141-6132f53d331a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:24.144538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee03c2-81ee-4d43-a141-6132f53d331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:24.161821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c3ee03c2-81ee-4d43-a141-6132f53d331a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:24.163020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c3ee03c2-81ee-4d43-a141-6132f53d331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:24.171094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:24.206957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258eebf-8507-4215-9c02-a5637f5874d0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:24.217355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258eebf-8507-4215-9c02-a5637f5874d0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:24.220785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac22e7-51b0-4178-b46d-a199502f7434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:24.221413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac22e7-51b0-4178-b46d-a199502f7434 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:24.221703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac22e7-51b0-4178-b46d-a199502f7434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:24.221968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac22e7-51b0-4178-b46d-a199502f7434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:24.230447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac22e7-51b0-4178-b46d-a199502f7434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:24.231894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac22e7-51b0-4178-b46d-a199502f7434 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:24.241373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 732/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:36:26.463075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e3cb1-55dd-4838-a885-a1f2ae02de3f None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:26.463075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e3cb1-55dd-4838-a885-a1f2ae02de3f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:26.463583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e3cb1-55dd-4838-a885-a1f2ae02de3f None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:26.464948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:26.470688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf513-6488-4413-a3cd-3ffe399584f4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:26.471159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf513-6488-4413-a3cd-3ffe399584f4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:26.471328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf513-6488-4413-a3cd-3ffe399584f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:26.488408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8dfcf513-6488-4413-a3cd-3ffe399584f4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:26.489584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8dfcf513-6488-4413-a3cd-3ffe399584f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:26.497192 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:26.533834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e3cb1-55dd-4838-a885-a1f2ae02de3f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:36:26.544186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e3cb1-55dd-4838-a885-a1f2ae02de3f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:36:26.547670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f6102-cd27-4840-8b1f-3be5bc98b3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:36:26.548294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6102-cd27-4840-8b1f-3be5bc98b3ac service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:26.548575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6102-cd27-4840-8b1f-3be5bc98b3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:26.548846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6102-cd27-4840-8b1f-3be5bc98b3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:26.557406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f6102-cd27-4840-8b1f-3be5bc98b3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:36:26.558824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f6102-cd27-4840-8b1f-3be5bc98b3ac service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:36:26.568166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 737/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:36:59.914268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b614e9-de2f-4e94-a691-a333d5cd6a02 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:59.914871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b614e9-de2f-4e94-a691-a333d5cd6a02 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:59.914871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b614e9-de2f-4e94-a691-a333d5cd6a02 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:59.916305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 734/1471] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:36:59.922095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a981-697f-4327-9486-034d72ec4901 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:59.922534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a981-697f-4327-9486-034d72ec4901 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:59.922638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a981-697f-4327-9486-034d72ec4901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:59.940723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5861a981-697f-4327-9486-034d72ec4901 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:36:59.941930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5861a981-697f-4327-9486-034d72ec4901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:36:59.949623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 738/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:36:59.995579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdeede-744f-4415-ab16-95fc8d7a9397 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:36:59.995896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdeede-744f-4415-ab16-95fc8d7a9397 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:36:59.996179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdeede-744f-4415-ab16-95fc8d7a9397 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:36:59.997547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 735/1473] 10.222.0.45 () {54 vars in 962 bytes} [Fri Apr 29 18:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:00.002397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fc46-e066-4439-864b-3f8319a10268 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:00.002686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fc46-e066-4439-864b-3f8319a10268 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:00.002993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fc46-e066-4439-864b-3f8319a10268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:00.021289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3659fc46-e066-4439-864b-3f8319a10268 None None] MFA Rules not processed for user `cef8f88990984c38945657983e4111f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:00.022448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3659fc46-e066-4439-864b-3f8319a10268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:00.028686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 739/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Apr 29 18:37:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:37:00.036178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdeede-744f-4415-ab16-95fc8d7a9397 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:00.046638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdeede-744f-4415-ab16-95fc8d7a9397 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:00.050176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af07ca-5d3a-4377-bae2-26feedf777fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:00.050805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af07ca-5d3a-4377-bae2-26feedf777fa service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:00.051092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af07ca-5d3a-4377-bae2-26feedf777fa service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:00.051400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af07ca-5d3a-4377-bae2-26feedf777fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:00.060119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af07ca-5d3a-4377-bae2-26feedf777fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:00.061540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af07ca-5d3a-4377-bae2-26feedf777fa service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:00.070759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 736/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:37:02.386089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60fbfc-2f2e-4e98-ab40-e1d2774f18c0 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:02.386618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60fbfc-2f2e-4e98-ab40-e1d2774f18c0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:02.386618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60fbfc-2f2e-4e98-ab40-e1d2774f18c0 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:02.387951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 740/1476] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:02.393467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cba47-89cc-4977-9962-4dec29df53a9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:02.393867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cba47-89cc-4977-9962-4dec29df53a9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:02.394028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cba47-89cc-4977-9962-4dec29df53a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:02.412426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d53cba47-89cc-4977-9962-4dec29df53a9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:02.413617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d53cba47-89cc-4977-9962-4dec29df53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:02.421771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 737/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:37:02.445692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60fbfc-2f2e-4e98-ab40-e1d2774f18c0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:02.457903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60fbfc-2f2e-4e98-ab40-e1d2774f18c0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:02.462342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:02.463051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:02.463284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:02.463558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:02.464314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:02.466066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:37:02.466066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:37:02.466066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:37:02.467242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8639-2420-4b54-949d-649622daf419 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:02.486262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 741/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Apr 29 18:37:02 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:37:04.719459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f1bd-487f-4bbb-bc0d-2ab13e1b7edd None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:04.719981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f1bd-487f-4bbb-bc0d-2ab13e1b7edd None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:04.719981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f1bd-487f-4bbb-bc0d-2ab13e1b7edd None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:04.721306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 738/1479] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:04.726445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca711-30ac-4adc-8436-8c7a1d5eabe1 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:04.726888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca711-30ac-4adc-8436-8c7a1d5eabe1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:04.726997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca711-30ac-4adc-8436-8c7a1d5eabe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:04.744456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4b6ca711-30ac-4adc-8436-8c7a1d5eabe1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:04.745647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4b6ca711-30ac-4adc-8436-8c7a1d5eabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:04.753423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 742/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:37:04.795742 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f1bd-487f-4bbb-bc0d-2ab13e1b7edd None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:04.811255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f1bd-487f-4bbb-bc0d-2ab13e1b7edd None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:04.817357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766aab-b4ce-41ac-959b-c657454a3734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:04.818236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766aab-b4ce-41ac-959b-c657454a3734 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:04.818517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766aab-b4ce-41ac-959b-c657454a3734 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:04.818795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766aab-b4ce-41ac-959b-c657454a3734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:04.828528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766aab-b4ce-41ac-959b-c657454a3734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:04.830408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766aab-b4ce-41ac-959b-c657454a3734 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:04.839604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 739/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:37:07.260188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6225271-c1a1-498c-ba8e-3b02f61c7228 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:07.260687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6225271-c1a1-498c-ba8e-3b02f61c7228 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:07.260811 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6225271-c1a1-498c-ba8e-3b02f61c7228 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:07.262125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 743/1482] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:07.267697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137569a6-74e6-4416-8720-73782831189b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:07.268109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137569a6-74e6-4416-8720-73782831189b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:07.268265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137569a6-74e6-4416-8720-73782831189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:07.286182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-137569a6-74e6-4416-8720-73782831189b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:07.287419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-137569a6-74e6-4416-8720-73782831189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:07.295159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 740/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:37:07.331209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6225271-c1a1-498c-ba8e-3b02f61c7228 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:07.341508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6225271-c1a1-498c-ba8e-3b02f61c7228 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:07.345491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfb23-5242-462a-900a-daa47f25b3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:07.346119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfb23-5242-462a-900a-daa47f25b3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:07.346400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfb23-5242-462a-900a-daa47f25b3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:07.346673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfb23-5242-462a-900a-daa47f25b3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:07.355337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cfb23-5242-462a-900a-daa47f25b3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:07.356765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cfb23-5242-462a-900a-daa47f25b3a7 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:07.366412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 744/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:37:09.640538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b268d-3cb5-4f95-b41f-2176ca90bf62 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:09.641134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b268d-3cb5-4f95-b41f-2176ca90bf62 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:09.641134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b268d-3cb5-4f95-b41f-2176ca90bf62 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:09.642474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 741/1485] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:09.647500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61614d0-9b10-4a21-87b8-c620513334b6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:09.647908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61614d0-9b10-4a21-87b8-c620513334b6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:09.648067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61614d0-9b10-4a21-87b8-c620513334b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:09.665159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a61614d0-9b10-4a21-87b8-c620513334b6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:09.666336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a61614d0-9b10-4a21-87b8-c620513334b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:09.674853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 745/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:37:09.711950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b268d-3cb5-4f95-b41f-2176ca90bf62 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:09.722346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b268d-3cb5-4f95-b41f-2176ca90bf62 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:09.725856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbabf9-ef3f-4348-99f2-b656eb9067d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:09.726488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbabf9-ef3f-4348-99f2-b656eb9067d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:09.726774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbabf9-ef3f-4348-99f2-b656eb9067d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:09.727052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbabf9-ef3f-4348-99f2-b656eb9067d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:09.736262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbabf9-ef3f-4348-99f2-b656eb9067d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:09.737677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbabf9-ef3f-4348-99f2-b656eb9067d3 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:09.746796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 742/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:37:12.145422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23491b3-a19b-4fe2-b81d-cf768b5bd080 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:12.146017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23491b3-a19b-4fe2-b81d-cf768b5bd080 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:12.146017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23491b3-a19b-4fe2-b81d-cf768b5bd080 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:12.147507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 746/1488] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:12.152663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414790c-6b88-47e2-ab89-f83b0cd4eb05 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:12.153120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414790c-6b88-47e2-ab89-f83b0cd4eb05 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:12.153225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414790c-6b88-47e2-ab89-f83b0cd4eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:12.171487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9414790c-6b88-47e2-ab89-f83b0cd4eb05 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:12.172664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9414790c-6b88-47e2-ab89-f83b0cd4eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:12.180360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 743/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:37:12.219954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23491b3-a19b-4fe2-b81d-cf768b5bd080 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:12.230243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23491b3-a19b-4fe2-b81d-cf768b5bd080 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:12.233686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f4cc-e88e-45ec-af81-f6ba78e776fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:12.234312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f4cc-e88e-45ec-af81-f6ba78e776fa service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:12.234595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f4cc-e88e-45ec-af81-f6ba78e776fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:12.234871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f4cc-e88e-45ec-af81-f6ba78e776fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:12.243417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f4cc-e88e-45ec-af81-f6ba78e776fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:12.244849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f4cc-e88e-45ec-af81-f6ba78e776fa service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:12.253864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 747/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:37:14.677353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a6a38-f4ee-4433-b06e-a337c7059c5f None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:14.677920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a6a38-f4ee-4433-b06e-a337c7059c5f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:14.677920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a6a38-f4ee-4433-b06e-a337c7059c5f None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:14.679336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 744/1491] 10.222.0.45 () {54 vars in 926 bytes} [Fri Apr 29 18:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:37:14.684402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c39b-aa8c-449d-b5bd-cca62dad1257 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:14.684823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c39b-aa8c-449d-b5bd-cca62dad1257 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:14.685003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c39b-aa8c-449d-b5bd-cca62dad1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:14.702097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e1e7c39b-aa8c-449d-b5bd-cca62dad1257 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:37:14.703306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e1e7c39b-aa8c-449d-b5bd-cca62dad1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:37:14.710862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 748/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Fri Apr 29 18:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:37:14.749247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a6a38-f4ee-4433-b06e-a337c7059c5f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:37:14.760191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a6a38-f4ee-4433-b06e-a337c7059c5f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:37:14.763930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4fd66-bd1d-4069-ae44-dc89d1a430ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:37:14.764562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4fd66-bd1d-4069-ae44-dc89d1a430ad service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:37:14.764842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4fd66-bd1d-4069-ae44-dc89d1a430ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:37:14.765117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4fd66-bd1d-4069-ae44-dc89d1a430ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:37:14.773683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4fd66-bd1d-4069-ae44-dc89d1a430ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:37:14.775093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4fd66-bd1d-4069-ae44-dc89d1a430ad service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:37:14.784660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 745/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:38:45.392556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.393185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.393185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.410522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:38:45.411736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:38:45.419518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 749/1494] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:38:45.427267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.427725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.427830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.445885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:38:45.447072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:38:45.455617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 746/1495] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:38:45.460058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.469510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c4d21-cbcc-4783-bd07-9ef356b2ea96 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.473921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.474570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.474849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.475139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.475860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:38:45.476161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.477164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:45.477164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:38:45.477164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:38:45.478042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.488958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 750/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:38:45.497332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.506318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc227f4-28ee-476e-8e32-90adc90334a7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.510890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.511573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.511858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.512135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.513426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.515505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:45.515505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:38:45.515505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:38:45.516707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.549915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 747/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:38:45 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:38:45.554253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.564275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c43c-ff40-4284-8ccb-c5f1518fbbd1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.616789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.617439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.617721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.617997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.618676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.619712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:45.619712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:38:45.619712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:38:45.620899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.641777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 751/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:38:45 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:38:45.645913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.655795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a2c2-cb08-4dd1-ba9f-bf58b2f5bca9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.660208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.660862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.661145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.661419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.662139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.663171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:45.663171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:38:45.663171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:38:45.664045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.676670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 748/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:38:45.680416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.690480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99d4e1-ef70-4898-9303-8ea2bef6f5fe admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.695135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.695798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.696085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.696364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.697087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.698119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:45.698119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:38:45.698119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:38:45.699001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fc043-85b9-48eb-a149-0867d4a6dc51 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.711699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 752/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:38:45.715679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.725117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288e33-d4af-4bad-ade0-d08462a21c7f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.729534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.730397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.730677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.730950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] PATH_INFO: `/v3/projects/9db9d895a4ab43138fd6c9d73b8ee097/users/7fcfee6099f848f9853698927fb3ca01/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.745628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db9d895a4ab43138fd6c9d73b8ee097, user_id=7fcfee6099f848f9853698927fb3ca01, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.746682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:45.746682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:38:45.746682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:38:45.749367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.762410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 749/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:38:45 2022] PUT /identity/v3/projects/9db9d895a4ab43138fd6c9d73b8ee097/users/7fcfee6099f848f9853698927fb3ca01/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:38:45.773705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a4fea-ed83-47bb-ba05-56ade5e99d82 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.774002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a4fea-ed83-47bb-ba05-56ade5e99d82 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.774284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a4fea-ed83-47bb-ba05-56ade5e99d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.800195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c46a4fea-ed83-47bb-ba05-56ade5e99d82 None None] MFA Rules not processed for user `7fcfee6099f848f9853698927fb3ca01`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:38:45.801383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c46a4fea-ed83-47bb-ba05-56ade5e99d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:38:45.863443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 753/1502] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:38:45.875080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:45.943299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe724b3f-207e-42b5-a9a1-9afb7d82ecc0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:45.948595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:45.949251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:45.949536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:45.949814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:45.957571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:45.959177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:45.968090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 750/1503] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:38:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:38:46.043439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378a58-6c91-4a83-a842-885b8e54e444 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:46.044379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378a58-6c91-4a83-a842-885b8e54e444 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:46.044661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03378a58-6c91-4a83-a842-885b8e54e444 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:46.046279 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 754/1504] 10.222.0.45 () {52 vars in 829 bytes} [Fri Apr 29 18:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:38:46.049778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:46.108745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51414ba3-1f84-4d01-90b8-a097dba6fb53 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:46.113267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:46.114146 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:46.114422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:46.114700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] PATH_INFO: `/v3/users/7fcfee6099f848f9853698927fb3ca01` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:46.115908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcfee6099f848f9853698927fb3ca01)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:46.116920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:46.116920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:38:46.116920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:38:46.118135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:46.179562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcfee6099f848f9853698927fb3ca01'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.196771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcfee6099f848f9853698927fb3ca01'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.205571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcfee6099f848f9853698927fb3ca01'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.206288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcfee6099f848f9853698927fb3ca01'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.206902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcfee6099f848f9853698927fb3ca01'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.224248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 751/1505] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:38:46 2022] DELETE /identity/v3/users/7fcfee6099f848f9853698927fb3ca01 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:38:46.228692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:46.229125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:46.229575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:46.247401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:38:46.248569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:38:46.304519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 755/1506] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:38:46.313932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:46.315358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:38:46.369692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579066-b273-42eb-af3d-5b3eee031008 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:46.373265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f575b6-58a7-4e41-aa2c-5f1e29efa734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:46.373905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f575b6-58a7-4e41-aa2c-5f1e29efa734 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:46.374186 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f575b6-58a7-4e41-aa2c-5f1e29efa734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:46.374462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f575b6-58a7-4e41-aa2c-5f1e29efa734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:46.383039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f575b6-58a7-4e41-aa2c-5f1e29efa734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:46.384476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f575b6-58a7-4e41-aa2c-5f1e29efa734 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:46.394272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 752/1507] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:38:46.706373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:38:46.707868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:38:46.720643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41600917-5d06-47ba-8ab8-728722b52371 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:38:46.726451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:38:46.727448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:38:46.727627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:38:46.727905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] PATH_INFO: `/v3/projects/9db9d895a4ab43138fd6c9d73b8ee097` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:38:46.729116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db9d895a4ab43138fd6c9d73b8ee097)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:38:46.730906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:38:46.730906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:38:46.730906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:38:46.732346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:38:46.797230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db9d895a4ab43138fd6c9d73b8ee097', 'request_id': 'req-300996b4-ab84-489b-8014-f048b8b96804'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.806440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db9d895a4ab43138fd6c9d73b8ee097', 'request_id': 'req-300996b4-ab84-489b-8014-f048b8b96804'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.812881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db9d895a4ab43138fd6c9d73b8ee097', 'request_id': 'req-300996b4-ab84-489b-8014-f048b8b96804'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.831937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] The token cache is being invalidate because project 9db9d895a4ab43138fd6c9d73b8ee097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:38:46.832226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.832883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-300996b4-ab84-489b-8014-f048b8b96804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:38:46.834523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 756/1508] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:38:46 2022] DELETE /identity/v3/projects/9db9d895a4ab43138fd6c9d73b8ee097 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:40:33.791811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0597-a968-4e60-b23b-43effc63bceb None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:33.792385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0597-a968-4e60-b23b-43effc63bceb None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:33.792385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0597-a968-4e60-b23b-43effc63bceb None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:33.793828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 753/1509] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:33.799049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db512e9-70ea-404b-a1eb-9c60a7d8491c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:33.799497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db512e9-70ea-404b-a1eb-9c60a7d8491c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:33.799653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db512e9-70ea-404b-a1eb-9c60a7d8491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:33.817993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3db512e9-70ea-404b-a1eb-9c60a7d8491c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:33.819248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3db512e9-70ea-404b-a1eb-9c60a7d8491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:33.880022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 757/1510] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:34.029506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e0597-a968-4e60-b23b-43effc63bceb None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:34.031699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-885e0597-a968-4e60-b23b-43effc63bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:34.104734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e0597-a968-4e60-b23b-43effc63bceb None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:34.110655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccb233-c999-456e-890d-ce00a102f2a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:34.111331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccb233-c999-456e-890d-ce00a102f2a1 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:34.111621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccb233-c999-456e-890d-ce00a102f2a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:34.111900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccb233-c999-456e-890d-ce00a102f2a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:34.119797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccb233-c999-456e-890d-ce00a102f2a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:34.121386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccb233-c999-456e-890d-ce00a102f2a1 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:34.130621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 754/1511] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:34.661754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2b3e-0fd6-4ea4-b042-767f11956301 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:34.662050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2b3e-0fd6-4ea4-b042-767f11956301 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:34.662337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b2b3e-0fd6-4ea4-b042-767f11956301 None None] PATH_INFO: `/v3` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:34.663680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 758/1512] 10.222.0.60 () {54 vars in 925 bytes} [Fri Apr 29 18:40:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:40:34.670365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4e8e2-1d3b-48c5-affe-6828de8d0a75 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:34.670687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4e8e2-1d3b-48c5-affe-6828de8d0a75 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:34.670986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4e8e2-1d3b-48c5-affe-6828de8d0a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:34.689099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-46b4e8e2-1d3b-48c5-affe-6828de8d0a75 None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:34.690906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-46b4e8e2-1d3b-48c5-affe-6828de8d0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:34.751149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 755/1513] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Apr 29 18:40:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:35.340986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351de67-5cd7-4131-9cd7-89d6fd2b85c1 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:35.341593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351de67-5cd7-4131-9cd7-89d6fd2b85c1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:35.341593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351de67-5cd7-4131-9cd7-89d6fd2b85c1 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:35.342952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:35.347788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf748e-931b-4e6b-8afb-91c0553f7bbf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:35.348222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf748e-931b-4e6b-8afb-91c0553f7bbf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:35.348384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf748e-931b-4e6b-8afb-91c0553f7bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:35.366497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-cadf748e-931b-4e6b-8afb-91c0553f7bbf None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:35.367722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-cadf748e-931b-4e6b-8afb-91c0553f7bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:35.376081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:35.525337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351de67-5cd7-4131-9cd7-89d6fd2b85c1 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:35.539941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351de67-5cd7-4131-9cd7-89d6fd2b85c1 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:35.545329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d08b3-288f-45f5-9127-1ef36028898a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:35.546610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d08b3-288f-45f5-9127-1ef36028898a service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:35.546898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d08b3-288f-45f5-9127-1ef36028898a service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:35.547212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d08b3-288f-45f5-9127-1ef36028898a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:35.555079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d08b3-288f-45f5-9127-1ef36028898a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:35.556718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d08b3-288f-45f5-9127-1ef36028898a service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:35.565904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 760/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:43.784584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d187987-5e90-4737-a547-158b6a09ab62 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:43.785113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d187987-5e90-4737-a547-158b6a09ab62 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:43.785113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d187987-5e90-4737-a547-158b6a09ab62 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:43.786447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 757/1517] 10.222.0.45 () {54 vars in 960 bytes} [Fri Apr 29 18:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:43.791525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1e5e-ae06-48dc-bd9d-ba2e281746cb None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:43.791933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1e5e-ae06-48dc-bd9d-ba2e281746cb None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:43.792087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1e5e-ae06-48dc-bd9d-ba2e281746cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:43.810238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5e1e1e5e-ae06-48dc-bd9d-ba2e281746cb None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:43.811505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5e1e1e5e-ae06-48dc-bd9d-ba2e281746cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:43.820126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 761/1518] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Apr 29 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:43.827765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d187987-5e90-4737-a547-158b6a09ab62 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:43.840827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d187987-5e90-4737-a547-158b6a09ab62 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:43.846232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5319f6-2852-4438-8f90-95cdce7a6146 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:43.846865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5319f6-2852-4438-8f90-95cdce7a6146 service placement] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:43.847185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5319f6-2852-4438-8f90-95cdce7a6146 service placement] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:43.847471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5319f6-2852-4438-8f90-95cdce7a6146 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:43.855520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5319f6-2852-4438-8f90-95cdce7a6146 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:43.857086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5319f6-2852-4438-8f90-95cdce7a6146 service placement] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:43.867241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 758/1519] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:47.166359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d96e-51be-4ac9-bc75-069bf31094af None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:47.166964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d96e-51be-4ac9-bc75-069bf31094af None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:47.166964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d96e-51be-4ac9-bc75-069bf31094af None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:47.168297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 762/1520] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:47.173025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e092-0918-4816-b1fa-f2743d285199 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:47.173501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e092-0918-4816-b1fa-f2743d285199 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:47.173607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e092-0918-4816-b1fa-f2743d285199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:47.190975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f785e092-0918-4816-b1fa-f2743d285199 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:47.192258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f785e092-0918-4816-b1fa-f2743d285199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:47.199939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 759/1521] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:47.350442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d96e-51be-4ac9-bc75-069bf31094af None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:47.364430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d96e-51be-4ac9-bc75-069bf31094af None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:47.369923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5fe33-ddd2-4ed4-8b54-89c973418fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:47.370557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fe33-ddd2-4ed4-8b54-89c973418fc8 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:47.370840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fe33-ddd2-4ed4-8b54-89c973418fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:47.371262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fe33-ddd2-4ed4-8b54-89c973418fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:47.379756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5fe33-ddd2-4ed4-8b54-89c973418fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:47.381385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5fe33-ddd2-4ed4-8b54-89c973418fc8 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:47.391416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 763/1522] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:48.616447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0fd4d-ede9-4af6-b93e-03c43647a291 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:48.617053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0fd4d-ede9-4af6-b93e-03c43647a291 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:48.617053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0fd4d-ede9-4af6-b93e-03c43647a291 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:48.618374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 760/1523] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 18:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:48.622999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639707e-8005-42fc-aa2a-2b275bc97afd None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:48.623422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639707e-8005-42fc-aa2a-2b275bc97afd None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:48.623596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639707e-8005-42fc-aa2a-2b275bc97afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:48.641714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3639707e-8005-42fc-aa2a-2b275bc97afd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:48.642918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3639707e-8005-42fc-aa2a-2b275bc97afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:48.650671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 764/1524] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 18:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:48.800975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0fd4d-ede9-4af6-b93e-03c43647a291 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:48.814908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0fd4d-ede9-4af6-b93e-03c43647a291 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:48.820254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970653a8-e00a-458b-ad7e-cd737ed0c7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:48.820892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970653a8-e00a-458b-ad7e-cd737ed0c7c1 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:48.821183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970653a8-e00a-458b-ad7e-cd737ed0c7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:48.821464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970653a8-e00a-458b-ad7e-cd737ed0c7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:48.829970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970653a8-e00a-458b-ad7e-cd737ed0c7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:48.831611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970653a8-e00a-458b-ad7e-cd737ed0c7c1 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:48.840929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 761/1525] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:53.351655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544eb4a-ad2e-494d-b74c-9049727bd812 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:53.352205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544eb4a-ad2e-494d-b74c-9049727bd812 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:53.352205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544eb4a-ad2e-494d-b74c-9049727bd812 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:53.353570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 765/1526] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:53.358687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9e5d-7422-4908-8f3d-da98e917baca None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:53.359134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9e5d-7422-4908-8f3d-da98e917baca None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:53.359244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9e5d-7422-4908-8f3d-da98e917baca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:53.377039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-a14f9e5d-7422-4908-8f3d-da98e917baca None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:53.378223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-a14f9e5d-7422-4908-8f3d-da98e917baca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:53.386197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 762/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:53.421453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544eb4a-ad2e-494d-b74c-9049727bd812 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:53.423125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6544eb4a-ad2e-494d-b74c-9049727bd812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:53.478514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544eb4a-ad2e-494d-b74c-9049727bd812 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:53.481990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73df5d-7fd2-4b4a-b35b-91c8ddbd0f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:53.482627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73df5d-7fd2-4b4a-b35b-91c8ddbd0f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:53.482912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73df5d-7fd2-4b4a-b35b-91c8ddbd0f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:53.483226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73df5d-7fd2-4b4a-b35b-91c8ddbd0f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:53.491798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73df5d-7fd2-4b4a-b35b-91c8ddbd0f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:53.493224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73df5d-7fd2-4b4a-b35b-91c8ddbd0f41 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:53.502688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 766/1528] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:55.712619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44ad6-f87c-4db1-a83b-6c538e9c8097 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:55.713147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44ad6-f87c-4db1-a83b-6c538e9c8097 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:55.713147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44ad6-f87c-4db1-a83b-6c538e9c8097 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:55.714488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 763/1529] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:55.720210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5785-d69b-4087-82fb-bb304e8e52b1 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:55.720641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5785-d69b-4087-82fb-bb304e8e52b1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:55.720765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5785-d69b-4087-82fb-bb304e8e52b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:55.738819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-746b5785-d69b-4087-82fb-bb304e8e52b1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:55.740051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-746b5785-d69b-4087-82fb-bb304e8e52b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:55.747779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 767/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:40:55.782959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44ad6-f87c-4db1-a83b-6c538e9c8097 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:40:55.793352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44ad6-f87c-4db1-a83b-6c538e9c8097 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:40:55.796800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80935984-d856-4042-8c29-179b3b370d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:40:55.799990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80935984-d856-4042-8c29-179b3b370d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:55.800273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80935984-d856-4042-8c29-179b3b370d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:55.800545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80935984-d856-4042-8c29-179b3b370d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:55.809770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80935984-d856-4042-8c29-179b3b370d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:40:55.811223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80935984-d856-4042-8c29-179b3b370d5c service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:40:55.820363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 764/1531] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:40:59.869819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3610f-8e22-49f6-8b23-5ffcbdab3b6e None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:59.870389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3610f-8e22-49f6-8b23-5ffcbdab3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:59.870389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3610f-8e22-49f6-8b23-5ffcbdab3b6e None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:59.871828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 768/1532] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:40:59.877413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c8f0-cd51-47d9-b161-cd4986f1680c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:40:59.877880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c8f0-cd51-47d9-b161-cd4986f1680c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:40:59.877984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4c8f0-cd51-47d9-b161-cd4986f1680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:40:59.895675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-47a4c8f0-cd51-47d9-b161-cd4986f1680c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:40:59.896865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-47a4c8f0-cd51-47d9-b161-cd4986f1680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:40:59.904643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 765/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:41:00.178590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3610f-8e22-49f6-8b23-5ffcbdab3b6e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:41:00.180305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-15d3610f-8e22-49f6-8b23-5ffcbdab3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:41:00.237590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3610f-8e22-49f6-8b23-5ffcbdab3b6e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:41:00.241122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84a49-4209-439f-8724-fd862b545bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:41:00.241764 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84a49-4209-439f-8724-fd862b545bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:41:00.242053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84a49-4209-439f-8724-fd862b545bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:41:00.242333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84a49-4209-439f-8724-fd862b545bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:41:00.251602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84a49-4209-439f-8724-fd862b545bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:41:00.253043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84a49-4209-439f-8724-fd862b545bd6 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:41:00.262217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 769/1534] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:41:02.543616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934679d1-2a6a-4b37-9104-be2d36f8ac96 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:41:02.544177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934679d1-2a6a-4b37-9104-be2d36f8ac96 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:41:02.544177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934679d1-2a6a-4b37-9104-be2d36f8ac96 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:41:02.545538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 766/1535] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 18:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:41:02.550957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e465-9dab-489a-ada5-4e42bfc8541c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:41:02.551428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e465-9dab-489a-ada5-4e42bfc8541c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:41:02.551540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e465-9dab-489a-ada5-4e42bfc8541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:41:02.574761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3c10e465-9dab-489a-ada5-4e42bfc8541c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:41:02.576017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3c10e465-9dab-489a-ada5-4e42bfc8541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:41:02.584626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 770/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 18:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:41:02.859171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906747fd-ff47-4362-b822-5e891447b9b9 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:41:02.859462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906747fd-ff47-4362-b822-5e891447b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:41:02.859739 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906747fd-ff47-4362-b822-5e891447b9b9 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:41:02.861107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 767/1537] 10.222.0.45 () {54 vars in 962 bytes} [Fri Apr 29 18:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:41:02.865930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5fc3e-5e52-4687-8131-85288a3fd7bf None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:41:02.866230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5fc3e-5e52-4687-8131-85288a3fd7bf None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:41:02.866517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5fc3e-5e52-4687-8131-85288a3fd7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:41:02.885901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f5b5fc3e-5e52-4687-8131-85288a3fd7bf None None] MFA Rules not processed for user `0de2845217b943189e11f8a6549b1524`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:41:02.887097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f5b5fc3e-5e52-4687-8131-85288a3fd7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:41:02.894312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 771/1538] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Apr 29 18:41:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:41:02.901588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906747fd-ff47-4362-b822-5e891447b9b9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:41:02.914607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906747fd-ff47-4362-b822-5e891447b9b9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:41:02.918149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32a642-713d-4a76-b5d6-d5bb83bc6416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:41:02.918787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32a642-713d-4a76-b5d6-d5bb83bc6416 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:41:02.919070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32a642-713d-4a76-b5d6-d5bb83bc6416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:41:02.919375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32a642-713d-4a76-b5d6-d5bb83bc6416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:41:02.928057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32a642-713d-4a76-b5d6-d5bb83bc6416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:41:02.929503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32a642-713d-4a76-b5d6-d5bb83bc6416 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:41:02.938587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 768/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:43.173414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.174077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.174077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.208043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.209483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.218408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 772/1540] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.228236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.228785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.228785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.252802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.254027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.269483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 769/1541] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.274446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.287382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e7c6-90f4-482e-b487-554eb00fba14 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.295973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.296941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.297389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.297827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.298730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:43.299226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.301043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117a575-4396-4362-8573-5d401fedf6d3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.319556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 773/1542] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:43.328242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.338045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588b7e8-25c3-46b7-aeed-cc96abc2da41 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.347802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.348502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.348791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.349072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.349784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.351776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.354601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f9aae-a316-4cd3-abcf-63ae7039b2fb None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.355059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f9aae-a316-4cd3-abcf-63ae7039b2fb None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.355521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f9aae-a316-4cd3-abcf-63ae7039b2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.387733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-942f9aae-a316-4cd3-abcf-63ae7039b2fb None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.389782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-942f9aae-a316-4cd3-abcf-63ae7039b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.395802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 770/1543] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:43.400113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.406369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 774/1544] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.418076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b700c-2b50-4d1a-94d8-4dca728a1f9f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.418076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b700c-2b50-4d1a-94d8-4dca728a1f9f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.418076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b700c-2b50-4d1a-94d8-4dca728a1f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.459297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d45b700c-2b50-4d1a-94d8-4dca728a1f9f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.460416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d45b700c-2b50-4d1a-94d8-4dca728a1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.526710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336791d6-20f5-4a4b-83c9-e207367b27ca admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.542486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.543893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.544207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.544542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.545289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.546339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:42:43.546339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:42:43.546339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:42:43.555548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b66ac-4e0d-4814-b288-e8729da0589b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.583304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 771/1545] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:42:43.585131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7fef-1203-4ca0-ab71-29a1dfd5aa58 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.585642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7fef-1203-4ca0-ab71-29a1dfd5aa58 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.586246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 775/1546] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:42:43.587000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7fef-1203-4ca0-ab71-29a1dfd5aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.587725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73cbc-f3d0-485c-bcbc-9ac2f5df3b74 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.588086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73cbc-f3d0-485c-bcbc-9ac2f5df3b74 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.588447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73cbc-f3d0-485c-bcbc-9ac2f5df3b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.606886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e5c73cbc-f3d0-485c-bcbc-9ac2f5df3b74 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.607977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9fcc7fef-1203-4ca0-ab71-29a1dfd5aa58 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.608573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e5c73cbc-f3d0-485c-bcbc-9ac2f5df3b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.609750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9fcc7fef-1203-4ca0-ab71-29a1dfd5aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.617926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 776/1547] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.619340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 772/1548] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.620079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.620587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.620849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.621216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.621480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.621593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.643749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.644593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.645156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.646218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.655311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 773/1549] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.659433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.660256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 777/1550] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.661375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.683932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3d75-334d-4767-93c1-9903a35abae8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.684900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f088-f7db-430a-ad10-3ea486c50dbc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.689722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.690331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5130c-63d8-4885-af1c-b05ff82debb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.690687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.690973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.691272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.692345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:43.694145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.694280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5130c-63d8-4885-af1c-b05ff82debb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.694280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5130c-63d8-4885-af1c-b05ff82debb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.694446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5130c-63d8-4885-af1c-b05ff82debb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.695091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5130c-63d8-4885-af1c-b05ff82debb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.695420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf5707-6afc-47a2-a0b4-50ea79219c50 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.696723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5130c-63d8-4885-af1c-b05ff82debb3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.707461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 774/1551] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:43.711606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 778/1552] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:43.711751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181b090-381a-4c79-b2c3-410165502f94 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.711751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181b090-381a-4c79-b2c3-410165502f94 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.711952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b64b0-c31e-443e-80b2-5de4b018392e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.712048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181b090-381a-4c79-b2c3-410165502f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.712146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b64b0-c31e-443e-80b2-5de4b018392e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.712146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b64b0-c31e-443e-80b2-5de4b018392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.727942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1181b090-381a-4c79-b2c3-410165502f94 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.728138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c33b64b0-c31e-443e-80b2-5de4b018392e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.729147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1181b090-381a-4c79-b2c3-410165502f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.729259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c33b64b0-c31e-443e-80b2-5de4b018392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.736936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 779/1553] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.739149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 775/1554] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.739306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745e297-2b4e-4342-9b82-2522742f830f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.739306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745e297-2b4e-4342-9b82-2522742f830f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.739485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa47fc-fcc5-44d7-a7b2-8934e01e595d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.739564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745e297-2b4e-4342-9b82-2522742f830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.739648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa47fc-fcc5-44d7-a7b2-8934e01e595d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.739825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa47fc-fcc5-44d7-a7b2-8934e01e595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.757057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7745e297-2b4e-4342-9b82-2522742f830f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.758223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0aaa47fc-fcc5-44d7-a7b2-8934e01e595d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.758339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7745e297-2b4e-4342-9b82-2522742f830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.759422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0aaa47fc-fcc5-44d7-a7b2-8934e01e595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.767149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 780/1555] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.771627 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 776/1556] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.771786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.771786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.771786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.772037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.772037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.772037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.787253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.788259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.788444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.789691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.796395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 781/1557] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.797198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.802175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 777/1558] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.802175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.807645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1e7e-6869-4e3f-a4f6-a5bebd546659 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.812862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.813435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371b55e-75fb-42cb-b98f-9fa65c5c3973 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.813545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.813792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.814073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.814798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.816459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.818876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.819562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.819842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.820112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.820796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.822669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.829837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 782/1559] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:43.829837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.837225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0037353-6b7c-4271-b1e3-dc8f0b796835 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.842755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.843442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.843722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.843997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.844709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:43.845016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.846606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.849759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 778/1560] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:43.850433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.865688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 783/1561] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:43.865688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.875027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238eeab-5352-4f46-8cb2-3c503aad666d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.910556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c666a2-c753-4e3a-bec7-43885b97ca14 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.915431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.916094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.916378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.916652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.917377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:43.917684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.918719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:42:43.918719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:42:43.918719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:42:43.919680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.928818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.929479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.929766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.930043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.930766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:43.930882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 779/1562] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:43.931081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.931780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.932731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335902-4f7c-476a-a38c-182530406248 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.941901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6337f8c-6a62-4b1f-9cc4-c732fcf96348 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.945589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 784/1563] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:43.946506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.946900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.947195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.947317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.947531 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.947651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.947752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.948456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:43.948789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:43.950329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c2c00-f562-4739-84ff-96255c5fd240 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:43.963256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 780/1564] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:43.964560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.964855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.965138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.966606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.967854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.975763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 785/1565] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.976526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:43.983307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:43.984481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:43.986000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae226c-67ea-4b2a-b4be-d2b21a4e3523 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:43.991096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:43.992124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:43.992264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:43.992569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] PATH_INFO: `/v3/projects/f352020b0b814196a7d879506c09e95c/users/9efa838c5b8f497882a41e65542dd28f/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:43.999143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 781/1566] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:43.999143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.007460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7c528-bd90-430b-872c-4ac35b8fd69e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.008949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f352020b0b814196a7d879506c09e95c, user_id=9efa838c5b8f497882a41e65542dd28f, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.010298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:42:44.010298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:42:44.010298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:42:44.012724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.013563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.014363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.014688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.015125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.016364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.018729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.026903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 786/1567] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:43 2022] PUT /identity/v3/projects/f352020b0b814196a7d879506c09e95c/users/9efa838c5b8f497882a41e65542dd28f/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:44.028051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.042620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 782/1568] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:43 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.042620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.050767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651adb3e-c329-4ea6-8400-2d5e6da92bb4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.090648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c68953-d843-4157-aebf-84f10ec6eaa1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.095589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.096246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.096530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.096805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.097594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.098615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:42:44.098615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:42:44.098615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:42:44.099842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.104922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.105568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.105854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.106131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.106813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.109282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.125000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 787/1569] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.126230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.138273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 783/1570] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.138989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.186045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9e93c-3827-4fe7-a352-1dd0cda69cad admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.197672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8df9d-8817-45d6-b75a-4cd7a8401856 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.202199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.202879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.203191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.203468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.204492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.206398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.230661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 784/1571] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.231514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.240975 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.241722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.242084 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.242431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.243251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.245300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.270492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 788/1572] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.271659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.291427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5c04-9ce2-446d-866c-f6b7988772c8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.330610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db978b-e9e1-4bed-bf49-caa1843350aa admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.335070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.335752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.336041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.336319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.337038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:44.337376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.338984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fe51-b2c7-46f8-a756-cf1a2773247c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.345284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.345980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.346286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.346561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.347310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:44.347753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.349443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.350575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 789/1573] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:44.351828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.352117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.352398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.374661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 785/1574] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:44.374661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.378027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] MFA Rules not processed for user `9efa838c5b8f497882a41e65542dd28f`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:44.379260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:44.384421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fe71-6a95-400e-8c3e-2e4ca722362c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.389134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.389792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.390081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.390362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.391378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.392978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.402463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 786/1575] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.403255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.413074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927601-35a3-4681-b6aa-9a94c7c8bd36 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.417651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.418304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.418591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.418872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.420214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.422112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.442110 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 787/1576] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.443043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.450843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 790/1577] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:44.450843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.452831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6fa1-0053-4e40-af80-21466038b56a admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.457423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.458086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.458377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.458660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.458901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400e85-d007-48f3-ab9b-f0f1557abe87 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.459427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.461392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.465231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.465922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.466214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.466982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.467776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.469727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.484225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 788/1578] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.485066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.494269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 791/1579] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.494269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.496736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e14d12-872b-4a8e-81f8-ded2eb5c33d6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.501393 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.501596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a9aa0-fa20-4559-a2c4-e5a26be528f0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.502046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.502334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.502607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.503322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.505579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.506405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.507047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.507397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.507710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.508419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.510347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.528502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 789/1580] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.528502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.538715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97fd7a-25a9-447d-9148-86b8991b3b28 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.540154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 792/1581] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.540986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.592600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.593269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.593556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.593833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.594525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.596466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.601872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84285c-3ff6-4afd-91e8-669713f00f23 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.606449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.607817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.608109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.608390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.609115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.610736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.620428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 793/1582] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.621241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.621655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 790/1583] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.622562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.631317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff801e3c-c75b-449e-92a3-3064008cead2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.682344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a813-bea8-414c-b548-f1b2fb3ceef6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.685727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.686392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.686683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.686892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.687016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.687571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.687710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.687863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.688139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.688818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.689333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.690683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.698796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 794/1584] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.699622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.709796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acdb6-954b-4952-a8cf-016be4867886 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.714481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.715157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.715448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.715723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.717001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.717616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 791/1585] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.718462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.718613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.728828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 795/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.729623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.738834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d066a-ab6f-475a-853e-138dd13f6805 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.782532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698213-4b27-46c6-a935-ac3a59b36f55 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.787172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.787842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.788135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.788420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.789148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.790745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.794561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.795300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.795593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.795872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.796593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.798195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.800476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 792/1587] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.801284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.808661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 796/1588] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.809333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.810353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d095d-6a30-434a-8b2c-f43440cdd75d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.814870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.815553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.815835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.816112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.816792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.818675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.818796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3ed50-39d1-4ccd-8cc3-6913206b6f8a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.823162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.824013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.824299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.824578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] PATH_INFO: `/v3/projects/63fc0e8c62a349618e4cce8fd83020e6/users/e08cd1708ccc4a2582baaae60ac691a9/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.838475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 793/1589] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 283 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.839302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.842963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fc0e8c62a349618e4cce8fd83020e6, user_id=e08cd1708ccc4a2582baaae60ac691a9, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.845677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.850790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb49361-bf14-40be-807e-b78c51544a2d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.855619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.856264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.856546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.856824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.857549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.858432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 797/1590] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:44 2022] PUT /identity/v3/projects/63fc0e8c62a349618e4cce8fd83020e6/users/e08cd1708ccc4a2582baaae60ac691a9/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:44.859277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.859470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.884360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 794/1591] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.885176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.895697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fc477-476f-4d0c-8dec-f5e1bef711bf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.924156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1968b-b5e8-402c-aedb-67337a200fd2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.928743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.929460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.929750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.930035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.930757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.932388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.942181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 798/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.943096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.952878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7493b87-7a5b-4d4a-ba66-e1515e8aa2a4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.953861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.954540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.954825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.955157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.955847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.957590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.957764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.958219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.958506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.958787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.959540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.961097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.971447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 799/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:44.972250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.981284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 795/1594] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:44 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:44.981284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:44.981553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab19f5-1d85-4909-9c05-1c8be3a80b7c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.986272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.986927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.987245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.987534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.988254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.988908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded76c-1283-4ef0-9af1-807634eb67bf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:44.989841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:44.993401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f985b83-cef7-45f7-910e-db481f381547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:44.994083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f985b83-cef7-45f7-910e-db481f381547 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:44.994338 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f985b83-cef7-45f7-910e-db481f381547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:44.994614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f985b83-cef7-45f7-910e-db481f381547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:44.995378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f985b83-cef7-45f7-910e-db481f381547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:44.996957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f985b83-cef7-45f7-910e-db481f381547 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.000210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 800/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.000852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.009554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 796/1596] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.009554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.009554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.009554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.010032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c135b-1a3e-4ef8-b214-68fff60e3efd admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.015159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.016070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.016357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.016635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.017353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.018933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.028526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 801/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.029869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.035153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] MFA Rules not processed for user `e08cd1708ccc4a2582baaae60ac691a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.036506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.038938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ef184-3eda-42c2-93ad-b8d547dad9f1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.043515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.044148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.044473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.044754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.045457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.047027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.056632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 802/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.057397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.067303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfab41-06e3-4ce3-bf64-b4fa5c9c5325 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.071935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.072785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.073074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.073355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] PATH_INFO: `/v3/projects/361c661f705d4a20aab09274092fc46d/users/c9a4f5ac438741bcad2867f46c4dfaeb/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.087763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361c661f705d4a20aab09274092fc46d, user_id=c9a4f5ac438741bcad2867f46c4dfaeb, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.090423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.098026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 797/1599] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.098899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.107980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 803/1600] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/361c661f705d4a20aab09274092fc46d/users/c9a4f5ac438741bcad2867f46c4dfaeb/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.107980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.114455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962322-89a3-491c-ad1b-d82b41346a19 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.170295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.171208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.171497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.171778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] PATH_INFO: `/v3/projects/7b9988dc509f4800bba1d1b66fa271d2/users/aeea9d59c41341db8496a2c63d8655fa/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.171897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f3a25-f39f-4f10-97e2-1bf28791e101 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.176384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.177044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.177333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.177610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.178332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.179977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.185943 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9988dc509f4800bba1d1b66fa271d2, user_id=aeea9d59c41341db8496a2c63d8655fa, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.188664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.190027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 804/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.190027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.201649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d75b1-a8f7-4f71-a1e8-c873c8e2beb7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.204255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 798/1602] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/7b9988dc509f4800bba1d1b66fa271d2/users/aeea9d59c41341db8496a2c63d8655fa/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.205044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.257692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.258487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.258768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.259050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] PATH_INFO: `/v3/projects/8e071a15822f4ffa90e9716ec2239e45/users/2bcb01a31f7e46e7867eb1bbc2fb1d6b/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.262994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba351c9e-8636-4d9f-acf4-4aae7ce03419 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.268595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.269516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.269800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.270074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] PATH_INFO: `/v3/projects/8a55068fcff34a5d9d2802659a986d21/users/ce510c50c0424237b81660d1d46a24d4/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.273734 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e071a15822f4ffa90e9716ec2239e45, user_id=2bcb01a31f7e46e7867eb1bbc2fb1d6b, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.276487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.284626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a55068fcff34a5d9d2802659a986d21, user_id=ce510c50c0424237b81660d1d46a24d4, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.287378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.289319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 805/1603] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/8e071a15822f4ffa90e9716ec2239e45/users/2bcb01a31f7e46e7867eb1bbc2fb1d6b/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.290108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.301891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 799/1604] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/8a55068fcff34a5d9d2802659a986d21/users/ce510c50c0424237b81660d1d46a24d4/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.302765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.349316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d6a7b-f57a-4dc6-8fdd-b648a3bd4ea2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.361654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce233-9ed0-46fe-9663-264c8e0d50f0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.366212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43231a84-781a-4848-af7f-0a33ad308f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.366888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231a84-781a-4848-af7f-0a33ad308f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.367205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231a84-781a-4848-af7f-0a33ad308f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.367488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43231a84-781a-4848-af7f-0a33ad308f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.368217 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43231a84-781a-4848-af7f-0a33ad308f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.369814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43231a84-781a-4848-af7f-0a33ad308f73 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.379842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 800/1605] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.381119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f134-84cf-4049-a712-9a6399437955 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.381422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f134-84cf-4049-a712-9a6399437955 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.381700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f134-84cf-4049-a712-9a6399437955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.399086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-98f3f134-84cf-4049-a712-9a6399437955 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.400301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-98f3f134-84cf-4049-a712-9a6399437955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.403897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548af5b-123e-445a-8e35-5765335283d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.404668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548af5b-123e-445a-8e35-5765335283d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.405052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548af5b-123e-445a-8e35-5765335283d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.405426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548af5b-123e-445a-8e35-5765335283d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.406267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548af5b-123e-445a-8e35-5765335283d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.407998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548af5b-123e-445a-8e35-5765335283d9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.408120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 801/1606] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.409371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbe96-b625-43c5-abc3-30c7b757b49c None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.409657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbe96-b625-43c5-abc3-30c7b757b49c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.410608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbe96-b625-43c5-abc3-30c7b757b49c None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.411392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 802/1607] 10.222.0.45 () {54 vars in 960 bytes} [Fri Apr 29 18:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:42:45.412125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfbe96-b625-43c5-abc3-30c7b757b49c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.421607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 806/1608] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.421607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fccf2e-a165-4f25-86b5-21f670ad8a17 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.421607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fccf2e-a165-4f25-86b5-21f670ad8a17 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.421607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fccf2e-a165-4f25-86b5-21f670ad8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.426244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfbe96-b625-43c5-abc3-30c7b757b49c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.430904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f6960-1e17-47e9-a9a0-826f69e82cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.431819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6960-1e17-47e9-a9a0-826f69e82cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.432105 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6960-1e17-47e9-a9a0-826f69e82cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.432386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6960-1e17-47e9-a9a0-826f69e82cbc admin admin] PATH_INFO: `/v3/projects/a3d88530c9ce424a82b8a63dca98c9c3/users/79bed4c0b8f94ca8906576364ce6c609/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.438995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c5fccf2e-a165-4f25-86b5-21f670ad8a17 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.440254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c5fccf2e-a165-4f25-86b5-21f670ad8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.447959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f6960-1e17-47e9-a9a0-826f69e82cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d88530c9ce424a82b8a63dca98c9c3, user_id=79bed4c0b8f94ca8906576364ce6c609, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.448091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 807/1609] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.449219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.449505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.449789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.451385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f6960-1e17-47e9-a9a0-826f69e82cbc admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.464738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 803/1610] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/a3d88530c9ce424a82b8a63dca98c9c3/users/79bed4c0b8f94ca8906576364ce6c609/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.466111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acbfd1-5ea3-4675-8840-c9e1288b7ae1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.466584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acbfd1-5ea3-4675-8840-c9e1288b7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.466967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acbfd1-5ea3-4675-8840-c9e1288b7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.470928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.472349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.492622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f4acbfd1-5ea3-4675-8840-c9e1288b7ae1 None None] MFA Rules not processed for user `ce510c50c0424237b81660d1d46a24d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.493821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f4acbfd1-5ea3-4675-8840-c9e1288b7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.530144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 808/1611] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.530972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.542772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8becc-e101-49a0-8c6c-175e85ec153f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.548256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.549140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.549422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.549700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] PATH_INFO: `/v3/projects/6830d25b09a549f8849db04c1632c4d6/users/7f0abeff2be84d51854bd3231864669e/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.557593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 804/1612] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.558879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.559206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.559481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.569043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6830d25b09a549f8849db04c1632c4d6, user_id=7f0abeff2be84d51854bd3231864669e, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.571783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.580090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.581293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.584652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 809/1613] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/6830d25b09a549f8849db04c1632c4d6/users/7f0abeff2be84d51854bd3231864669e/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.585616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.647648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a312-ed92-41ea-8b4c-6c0fc20a666d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.648441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 805/1614] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.649191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.652374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.653264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.653549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.653857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] PATH_INFO: `/v3/projects/8728707ffd4e4c33ac708bc62ce7a5ce/users/71bd6146b87d4771af2d02a794b35905/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.668287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8728707ffd4e4c33ac708bc62ce7a5ce, user_id=71bd6146b87d4771af2d02a794b35905, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.671523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.684038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 810/1615] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:45 2022] PUT /identity/v3/projects/8728707ffd4e4c33ac708bc62ce7a5ce/users/71bd6146b87d4771af2d02a794b35905/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:45.685646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.702328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce840d-ad9f-4bf1-8bae-0247ff1584d0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.737437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4dde4-005a-4cbf-bf46-4e0f7a789a80 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.741182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.741826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.742111 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.742391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.749046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.749696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.749979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.750257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.800243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.801613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.808160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.809582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.811657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 811/1616] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:45.812457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.819673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 806/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:45.820488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.821372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f35ad-ed85-47cd-b06f-c89aaae0c45e service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.821762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.826106 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.826882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.827069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.827351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.828107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.829684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.831976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc08d9-1414-419d-bf9a-c9bf612ec1b9 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.836072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577537e-5bbe-4b15-bfba-83b1ce59d1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.836671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577537e-5bbe-4b15-bfba-83b1ce59d1aa service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.836953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577537e-5bbe-4b15-bfba-83b1ce59d1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.837228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577537e-5bbe-4b15-bfba-83b1ce59d1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.843616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 812/1618] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:45.844699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.848322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577537e-5bbe-4b15-bfba-83b1ce59d1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.850059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577537e-5bbe-4b15-bfba-83b1ce59d1aa service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.855147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbf765-d838-4ff9-8e42-5732869a7df0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.862278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.862963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.863284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.863578 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.864258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:45.866179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:45.871404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 807/1619] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:45.873157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53542267-702a-4226-8b18-eedaefc3bf77 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.873606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53542267-702a-4226-8b18-eedaefc3bf77 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.874022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53542267-702a-4226-8b18-eedaefc3bf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.893919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-53542267-702a-4226-8b18-eedaefc3bf77 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.895433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-53542267-702a-4226-8b18-eedaefc3bf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:45.895966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 813/1620] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:45.899796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:45.963903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 808/1621] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:45.965308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.965713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.965857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.978742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac4265-88bb-4331-83a3-5401f7ff5604 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:45.986200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:45.986990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:45.987397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:45.987706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:45.998104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] MFA Rules not processed for user `71bd6146b87d4771af2d02a794b35905`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:45.999443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:46.052018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.054057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.065371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 814/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:46.066315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.077183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13985b-cdc9-4b12-ad78-17a10d146e75 service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.082373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.083187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.083492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.083818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] PATH_INFO: `/v3/projects/a3d88530c9ce424a82b8a63dca98c9c3/users/79bed4c0b8f94ca8906576364ce6c609/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.086094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d88530c9ce424a82b8a63dca98c9c3, user_id=79bed4c0b8f94ca8906576364ce6c609, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.089071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.099007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 809/1623] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:46.099829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.106694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 815/1624] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:46 2022] PUT /identity/v3/projects/a3d88530c9ce424a82b8a63dca98c9c3/users/79bed4c0b8f94ca8906576364ce6c609/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:46.117907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.118224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2fd1-21f4-49c8-8c7b-3bf7bbff6fa8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.182144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7b03-fbc3-4540-844c-08e69bb299fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.182558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827b7d-f4c2-4c6e-a665-6d2e9886b536 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.182837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7b03-fbc3-4540-844c-08e69bb299fe admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.183141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7b03-fbc3-4540-844c-08e69bb299fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.183545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7b03-fbc3-4540-844c-08e69bb299fe admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.184579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d7b03-fbc3-4540-844c-08e69bb299fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.186666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.186835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d7b03-fbc3-4540-844c-08e69bb299fe admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.187405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.187695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.188095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.198826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.201304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.211875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 816/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:46.212524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.214419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 810/1626] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:46 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:46.215707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.216024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.216885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.230705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3068ba-efd5-4c5f-9ea0-2e6bed950307 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.243362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.244043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.244328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.244607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.245500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.247313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.265447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] MFA Rules not processed for user `79bed4c0b8f94ca8906576364ce6c609`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:46.267286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:46.288139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 817/1627] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:46 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:46.289336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.437544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d22e10-c0c5-4425-9e0a-fc58e8b9525c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.446108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.446842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.447429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.447429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.448338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.450345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.465350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 818/1628] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:46.466515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.477328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241991-d3c2-42e6-8dc1-9644593e8f3a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.483136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a494ba-d588-4c5c-a7f1-9045e420705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.483843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a494ba-d588-4c5c-a7f1-9045e420705c admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.484133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a494ba-d588-4c5c-a7f1-9045e420705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.484413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a494ba-d588-4c5c-a7f1-9045e420705c admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.485214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a494ba-d588-4c5c-a7f1-9045e420705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.487347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a494ba-d588-4c5c-a7f1-9045e420705c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.512465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 819/1629] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:46 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:46.514117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b3a4-2868-448e-9f1d-2feaf630b6f6 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.514453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b3a4-2868-448e-9f1d-2feaf630b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.514738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187b3a4-2868-448e-9f1d-2feaf630b6f6 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.515268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 811/1630] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:46.516448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.522344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 820/1631] 10.222.0.45 () {54 vars in 912 bytes} [Fri Apr 29 18:42:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:42:46.523128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187b3a4-2868-448e-9f1d-2feaf630b6f6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.537410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187b3a4-2868-448e-9f1d-2feaf630b6f6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.537909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1600c64-a0ba-4c92-8482-57dcf9365bbf None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.543737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcc3aa-b2bd-4aa5-a538-fb801d1c7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.543946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.545080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcc3aa-b2bd-4aa5-a538-fb801d1c7af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.545366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.545686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcc3aa-b2bd-4aa5-a538-fb801d1c7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.545811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.546060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] PATH_INFO: `/v3/projects/f40608bac0bd458293942f7477d11d62/users/05cccb04316044299a9a2f4d3bcea922/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.546180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcc3aa-b2bd-4aa5-a538-fb801d1c7af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.547156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcc3aa-b2bd-4aa5-a538-fb801d1c7af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.548986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcc3aa-b2bd-4aa5-a538-fb801d1c7af6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.564591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 821/1632] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:46.566251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.566609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.567032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.574380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40608bac0bd458293942f7477d11d62, user_id=05cccb04316044299a9a2f4d3bcea922, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.577603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.588320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:46.589671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:46.598744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 812/1633] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:46 2022] PUT /identity/v3/projects/f40608bac0bd458293942f7477d11d62/users/05cccb04316044299a9a2f4d3bcea922/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:46.600035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.704266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67fd1d-eb35-4ea7-8b6b-52bec75a5f05 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.707961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.709526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.709990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.710366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.767531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 822/1634] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:42:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:46.768408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.858921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.860653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.861679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3119d-b600-4298-a0ad-8b58e9aa624f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:46.867986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:46.869766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:46.870176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:46.870558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] PATH_INFO: `/v3/projects/54dd5c74897444b2a3716911c5e534c1/users/b397e766ef3144cdbc20a53381b49c1f/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:46.885186 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 813/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:46.886219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.889044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dd5c74897444b2a3716911c5e534c1, user_id=b397e766ef3144cdbc20a53381b49c1f, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:46.892593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:46.918355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 823/1636] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:46 2022] PUT /identity/v3/projects/54dd5c74897444b2a3716911c5e534c1/users/b397e766ef3144cdbc20a53381b49c1f/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:46.919245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:46.925523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efe496-6d58-4704-8b1f-1a7e5ba24839 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.021065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b144-0cd9-4b37-b869-64e33d8feb9d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.026280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.027006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.027336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.028054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.077209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.078050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.078409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.078871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.079778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.081680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.098773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 814/1637] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:47.100144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.114309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb955-c28f-4201-8d09-a870e2be7be6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.121077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.121751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.122675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.123010 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.123839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.125455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.137647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 815/1638] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:47.139360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.144569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.146161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.153371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a275-219f-4ee5-9003-3cb6bf459082 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.158974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 824/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:47.161684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.171427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.172613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.172613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.172801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] PATH_INFO: `/v3/users/9efa838c5b8f497882a41e65542dd28f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.173150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e7ee0-ec80-4680-ba62-28315404d945 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.178856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.179873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.180228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.180421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efa838c5b8f497882a41e65542dd28f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.180922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] PATH_INFO: `/v3/projects/f40608bac0bd458293942f7477d11d62/users/05cccb04316044299a9a2f4d3bcea922/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.183054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40608bac0bd458293942f7477d11d62, user_id=05cccb04316044299a9a2f4d3bcea922, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.183205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.186016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.197762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 825/1640] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:47 2022] PUT /identity/v3/projects/f40608bac0bd458293942f7477d11d62/users/05cccb04316044299a9a2f4d3bcea922/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:47.198900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.281460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efa838c5b8f497882a41e65542dd28f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:47.309349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f79f13-8f9b-474c-a8c1-cbc3a65eb64b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.314445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efa838c5b8f497882a41e65542dd28f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:47.322746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8076-99e3-405e-aa1e-27f9e2d4faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.324131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8076-99e3-405e-aa1e-27f9e2d4faf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.324729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8076-99e3-405e-aa1e-27f9e2d4faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.325398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8076-99e3-405e-aa1e-27f9e2d4faf5 admin admin] PATH_INFO: `/v3/projects/54dd5c74897444b2a3716911c5e534c1/users/b397e766ef3144cdbc20a53381b49c1f/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.326822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efa838c5b8f497882a41e65542dd28f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:47.327620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efa838c5b8f497882a41e65542dd28f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:47.328273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abe8dea3-cd49-4a30-aa8c-88ade2118103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efa838c5b8f497882a41e65542dd28f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:47.329093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a8076-99e3-405e-aa1e-27f9e2d4faf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dd5c74897444b2a3716911c5e534c1, user_id=b397e766ef3144cdbc20a53381b49c1f, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.334389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a8076-99e3-405e-aa1e-27f9e2d4faf5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.351775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 816/1641] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:42:47 2022] DELETE /identity/v3/users/9efa838c5b8f497882a41e65542dd28f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:47.356322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ec55a-d1e2-48dc-b935-acf6c9cfa8ee None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.358017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ec55a-d1e2-48dc-b935-acf6c9cfa8ee None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.358545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ec55a-d1e2-48dc-b935-acf6c9cfa8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.360288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 826/1642] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:47 2022] PUT /identity/v3/projects/54dd5c74897444b2a3716911c5e534c1/users/b397e766ef3144cdbc20a53381b49c1f/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:47.362694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.363254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.363756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.453374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:47.457130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:47.472059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-055ec55a-d1e2-48dc-b935-acf6c9cfa8ee None None] MFA Rules not processed for user `05cccb04316044299a9a2f4d3bcea922`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:47.483296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-055ec55a-d1e2-48dc-b935-acf6c9cfa8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:47.604328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 817/1643] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:47.605760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.605907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.606193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.648215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] MFA Rules not processed for user `b397e766ef3144cdbc20a53381b49c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:47.649827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:47.665178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 827/1644] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:47.665178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.668328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:47.763324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 818/1645] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:47.765429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.767433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:47.804059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c9137-8ae2-44ce-a653-a55a27e69d2c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.811709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d6e9d-db8a-4c67-880a-84ba33dff189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.812375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6e9d-db8a-4c67-880a-84ba33dff189 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.812660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6e9d-db8a-4c67-880a-84ba33dff189 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.812941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6e9d-db8a-4c67-880a-84ba33dff189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.837563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d6e9d-db8a-4c67-880a-84ba33dff189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.837840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc0266-591a-436f-be4d-c5bec983a90e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.839304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d6e9d-db8a-4c67-880a-84ba33dff189 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.843843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.845108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.845653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.845902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.860312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:47.861318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 828/1646] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:47.862416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:47.864236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.865786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.866275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:47.875424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 819/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:47.920883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] MFA Rules not processed for user `2bcb01a31f7e46e7867eb1bbc2fb1d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:47.920883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:47.937464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:47.953485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adcb91-8e7a-4ffe-8e29-9b0365e9c67e service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:47.981454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3c824-93f9-4c3e-be32-2f8f39ec9d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:47.983474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c824-93f9-4c3e-be32-2f8f39ec9d0d service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:47.985017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c824-93f9-4c3e-be32-2f8f39ec9d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:47.986830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c824-93f9-4c3e-be32-2f8f39ec9d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.029933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3c824-93f9-4c3e-be32-2f8f39ec9d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:48.032385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3c824-93f9-4c3e-be32-2f8f39ec9d0d service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:48.065935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 820/1648] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:48.095422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 829/1649] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:48.109362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.109875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.110372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.140988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] MFA Rules not processed for user `2bcb01a31f7e46e7867eb1bbc2fb1d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:48.148108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:48.190941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 821/1650] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:48.209107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:48.210514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:48.228266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:48.229723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:48.264180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c0f0-cbf1-4c7b-a931-df99735112ce None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:48.284535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:48.285509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.285509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.285758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.290941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:48.429765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0279a-9994-4c87-9e59-1f8d9b550e16 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:48.443998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f427-b864-44a5-adf4-98b4f2276638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:48.444708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f427-b864-44a5-adf4-98b4f2276638 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.448813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f427-b864-44a5-adf4-98b4f2276638 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.448813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f427-b864-44a5-adf4-98b4f2276638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.470059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8f427-b864-44a5-adf4-98b4f2276638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:48.473393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8f427-b864-44a5-adf4-98b4f2276638 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:48.494975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:48.496729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada063-dfd5-46ca-8e28-9b1f3dfa76df service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:48.504192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 830/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:48.520256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 822/1652] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:42:48.901236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe60d6-46fd-439d-8d26-2f0c3f58df88 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.901520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe60d6-46fd-439d-8d26-2f0c3f58df88 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.901802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe60d6-46fd-439d-8d26-2f0c3f58df88 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.905113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 831/1653] 10.222.0.45 () {54 vars in 960 bytes} [Fri Apr 29 18:42:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:42:48.911248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27338-db38-49f3-8910-bd1140de87a8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.911362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27338-db38-49f3-8910-bd1140de87a8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.911693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27338-db38-49f3-8910-bd1140de87a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.943927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-68c27338-db38-49f3-8910-bd1140de87a8 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:48.947493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-68c27338-db38-49f3-8910-bd1140de87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:48.968609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 823/1654] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Apr 29 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:48.973891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39e77-e647-4468-971a-d7685ebb46e6 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.974396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39e77-e647-4468-971a-d7685ebb46e6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.974741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39e77-e647-4468-971a-d7685ebb46e6 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:48.976245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 832/1655] 10.222.0.45 () {54 vars in 912 bytes} [Fri Apr 29 18:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:42:48.982154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:48.984815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:48.985251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.043333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:49.044670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:49.085930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 824/1656] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:49.102455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39e77-e647-4468-971a-d7685ebb46e6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:49.118076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39e77-e647-4468-971a-d7685ebb46e6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:49.126797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:49.127683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.128015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.128295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.147666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:49.149916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:49.181379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:49.183195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:49.185526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 833/1657] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:49.198234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:49.199913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:49.222134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358343d2-5f22-4d40-bdd5-1b61e0908a79 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:49.235043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a567184-59a4-4a16-98b1-0cc226313595 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:49.239620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:49.240647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.241041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.241429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] PATH_INFO: `/v3/users/71bd6146b87d4771af2d02a794b35905` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.243639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71bd6146b87d4771af2d02a794b35905)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:49.246408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:49.248864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:49.251601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.251899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.252678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] PATH_INFO: `/v3/projects/f352020b0b814196a7d879506c09e95c` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.256210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f352020b0b814196a7d879506c09e95c)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:49.259247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:49.378166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71bd6146b87d4771af2d02a794b35905'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.378933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f352020b0b814196a7d879506c09e95c', 'request_id': 'req-b0ef3ccf-b18f-44e6-9a07-18342139f282'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.393964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f352020b0b814196a7d879506c09e95c', 'request_id': 'req-b0ef3ccf-b18f-44e6-9a07-18342139f282'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.405732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f352020b0b814196a7d879506c09e95c', 'request_id': 'req-b0ef3ccf-b18f-44e6-9a07-18342139f282'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.413130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71bd6146b87d4771af2d02a794b35905'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.437112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71bd6146b87d4771af2d02a794b35905'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.440733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] The token cache is being invalidate because project f352020b0b814196a7d879506c09e95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:42:49.441033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.444221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.451453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 834/1658] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:42:49 2022] DELETE /identity/v3/projects/f352020b0b814196a7d879506c09e95c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:49.453423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:49.453961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71bd6146b87d4771af2d02a794b35905'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.456490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-70c908d0-d163-429a-8b87-8eb482400fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71bd6146b87d4771af2d02a794b35905'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.458996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:49.480317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 825/1659] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:42:49 2022] DELETE /identity/v3/users/71bd6146b87d4771af2d02a794b35905 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:42:49.485026 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f30f-2818-4293-bd0b-ea3ba30c3d79 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.486491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f30f-2818-4293-bd0b-ea3ba30c3d79 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.487194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f30f-2818-4293-bd0b-ea3ba30c3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.519082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b178f30f-2818-4293-bd0b-ea3ba30c3d79 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:49.520622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b178f30f-2818-4293-bd0b-ea3ba30c3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:49.679817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3ccf-b18f-44e6-9a07-18342139f282 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:49.685590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 826/1660] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:49.693031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:49.694147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.695907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.696381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] PATH_INFO: `/v3/users/79bed4c0b8f94ca8906576364ce6c609` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.700132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5d175-f9a5-46fb-9df4-127fbcddb5c2 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.700716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5d175-f9a5-46fb-9df4-127fbcddb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.701283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5d175-f9a5-46fb-9df4-127fbcddb5c2 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.702248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bed4c0b8f94ca8906576364ce6c609)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:49.703559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: WARNING py.warnings [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:42:49.703559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: warnings.warn(msg) Apr 29 18:42:49.703559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: Apr 29 18:42:49.706347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 827/1661] 10.222.0.45 () {54 vars in 912 bytes} [Fri Apr 29 18:42:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:42:49.708572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:49.709797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5d175-f9a5-46fb-9df4-127fbcddb5c2 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:49.712713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e1a5d175-f9a5-46fb-9df4-127fbcddb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:49.859999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bed4c0b8f94ca8906576364ce6c609'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.901831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5d175-f9a5-46fb-9df4-127fbcddb5c2 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:49.907062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bed4c0b8f94ca8906576364ce6c609'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.922657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bed4c0b8f94ca8906576364ce6c609'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.923559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bed4c0b8f94ca8906576364ce6c609'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.929933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:49.931210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.931540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.931826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.944410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3448a4a3-1cdb-4d52-af07-76d632ed1198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bed4c0b8f94ca8906576364ce6c609'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:49.955176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 835/1662] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:42:49 2022] DELETE /identity/v3/users/79bed4c0b8f94ca8906576364ce6c609 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:49.956591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:49.956893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:49.957214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:49.960117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:49.961847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:49.989962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 828/1663] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:50.055790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:50.057032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:50.139691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 836/1664] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:50.205629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:50.209041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:50.246662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3e94c-8a79-47b5-be3a-c662ad45c910 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:50.259496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:50.262908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:50.267069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:50.267411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:50.284532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:50.286971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:50.303974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 829/1665] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:51.006507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:51.008457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:51.213793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9de0f-6854-4e9f-bfc3-305e30aded86 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:51.243253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:51.244427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:51.244940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:51.245400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] PATH_INFO: `/v3/users/e08cd1708ccc4a2582baaae60ac691a9` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:51.251293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08cd1708ccc4a2582baaae60ac691a9)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:51.254792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:51.367491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08cd1708ccc4a2582baaae60ac691a9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.369814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:51.374408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:51.422679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6aa57-cb94-4ff7-a108-71e853e14cb2 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:51.424500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08cd1708ccc4a2582baaae60ac691a9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.432898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:51.434598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:51.435811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:51.436337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] PATH_INFO: `/v3/projects/a3d88530c9ce424a82b8a63dca98c9c3` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:51.439934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d88530c9ce424a82b8a63dca98c9c3)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:51.451287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: WARNING py.warnings [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 18:42:51.451287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: warnings.warn(msg) Apr 29 18:42:51.451287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: Apr 29 18:42:51.451287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:51.464780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08cd1708ccc4a2582baaae60ac691a9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.471761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08cd1708ccc4a2582baaae60ac691a9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.482630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08cd1708ccc4a2582baaae60ac691a9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.507289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 837/1666] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:42:51 2022] DELETE /identity/v3/users/e08cd1708ccc4a2582baaae60ac691a9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:51.507871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:51.510973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:51.641503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d88530c9ce424a82b8a63dca98c9c3', 'request_id': 'req-725b22a0-ffa9-44a8-bac4-a85e654ce50e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.669923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d88530c9ce424a82b8a63dca98c9c3', 'request_id': 'req-725b22a0-ffa9-44a8-bac4-a85e654ce50e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.686367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d88530c9ce424a82b8a63dca98c9c3', 'request_id': 'req-725b22a0-ffa9-44a8-bac4-a85e654ce50e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.739239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba105-b222-452f-88b9-78008bac04c4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:51.751367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] The token cache is being invalidate because project a3d88530c9ce424a82b8a63dca98c9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:42:51.752063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.753834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-725b22a0-ffa9-44a8-bac4-a85e654ce50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:51.757824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 830/1667] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:42:51 2022] DELETE /identity/v3/projects/a3d88530c9ce424a82b8a63dca98c9c3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:51.760808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b73ff-50fc-4187-9d3e-aad10472a42f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:51.760808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b73ff-50fc-4187-9d3e-aad10472a42f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:51.764786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b73ff-50fc-4187-9d3e-aad10472a42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:51.809085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-610b73ff-50fc-4187-9d3e-aad10472a42f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:51.811148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-610b73ff-50fc-4187-9d3e-aad10472a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:51.897483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:51.905290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:51.911537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:51.911900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] PATH_INFO: `/v3/projects/8728707ffd4e4c33ac708bc62ce7a5ce` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:51.916862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8728707ffd4e4c33ac708bc62ce7a5ce)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:51.923805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:52.045219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 831/1668] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:52.049085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a152-4ea5-42ca-9eec-b021ef4df9c8 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.049715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a152-4ea5-42ca-9eec-b021ef4df9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.050821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94a152-4ea5-42ca-9eec-b021ef4df9c8 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.052898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 832/1669] 10.222.0.45 () {54 vars in 960 bytes} [Fri Apr 29 18:42:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:42:52.054309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.054795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.055879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.080946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8728707ffd4e4c33ac708bc62ce7a5ce', 'request_id': 'req-f0ce7919-3bc6-48c2-a682-a866743b93ee'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.103585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8728707ffd4e4c33ac708bc62ce7a5ce', 'request_id': 'req-f0ce7919-3bc6-48c2-a682-a866743b93ee'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.117515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8728707ffd4e4c33ac708bc62ce7a5ce', 'request_id': 'req-f0ce7919-3bc6-48c2-a682-a866743b93ee'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.134666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:52.140471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.157581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] The token cache is being invalidate because project 8728707ffd4e4c33ac708bc62ce7a5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:42:52.158335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.161711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f0ce7919-3bc6-48c2-a682-a866743b93ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.164827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 838/1670] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:42:51 2022] DELETE /identity/v3/projects/8728707ffd4e4c33ac708bc62ce7a5ce => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:52.166364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.167962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.168620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.213434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] MFA Rules not processed for user `ec1a79f8ea404a01b92ecabe8ca79b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:52.215520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.306081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 833/1671] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:52.306081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:52.306081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.397926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 839/1672] 10.222.0.45 () {58 vars in 1057 bytes} [Fri Apr 29 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:52.399616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:52.401315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.424715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312932e-48f2-4c4f-8c3e-8a602907ef80 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:52.432617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34ca9a-1f60-4de6-ba30-3b2a565cecb1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:52.467463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:52.471495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.472408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:52.472991 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.474067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] PATH_INFO: `/v3/users/b397e766ef3144cdbc20a53381b49c1f` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.475421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.476103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.476568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.477464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b397e766ef3144cdbc20a53381b49c1f)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:52.481160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:52.482726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.522805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:52.525460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f834a9-f241-4885-975e-1d2ec9a6463d service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:52.565939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 834/1673] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:52.568809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.582887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.583544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.625546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:52.627942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.642062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b397e766ef3144cdbc20a53381b49c1f'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.664443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 835/1674] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:52.666044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:52.702515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727554b-8912-4a73-96fb-18aee4b8fdc3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:52.708361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:52.709200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b397e766ef3144cdbc20a53381b49c1f'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.709369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.709686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.709975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.713171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.738570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b397e766ef3144cdbc20a53381b49c1f'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.739548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b397e766ef3144cdbc20a53381b49c1f'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.747913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b397e766ef3144cdbc20a53381b49c1f'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:52.751733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:52.753465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:52.761600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 840/1675] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:42:52 2022] DELETE /identity/v3/users/b397e766ef3144cdbc20a53381b49c1f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:52.763004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:52.764904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:52.778226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 836/1676] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:52.844037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d238e-50c0-4fe1-a1c5-2ff7def33bfd admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:52.849231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:52.850072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.850456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.850832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.851708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:52.852111 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:52.853831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:52.866921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 841/1677] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:52.871665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:52.886039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede1964-675c-40f6-a284-4fa72e737ba8 service placement] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:52.913982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:52.914689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:52.914981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:52.915347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:52.916066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:52.920181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:52.986422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 837/1678] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:52 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:52.987768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:53.009585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd18ea-94d4-40ef-8160-a6ba873b239b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:53.219093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:53.225323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.225693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.225991 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.226745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:53.228797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:53.278258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 842/1679] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:52 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:53.282541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:53.297223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807aea-5032-40bc-b5e4-24737df56f57 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:53.313955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:53.314672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.314965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.315581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.316715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:53.318366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:53.362096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 838/1680] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:53.365646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:53.381503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35065cd1-e2a5-4849-9678-9ee488a7cf7a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:53.399119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:53.400088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.400408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.401607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.406699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:53.408435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:53.448526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:53.450334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:53.460272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 843/1681] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:53.467193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:53.493797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ba65-a535-412f-909c-ba740e854d08 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:53.507978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15db91-320f-451c-afba-025b245ab6a0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:53.514112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:53.515179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.516191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.517765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] PATH_INFO: `/v3/projects/54dd5c74897444b2a3716911c5e534c1` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.526078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dd5c74897444b2a3716911c5e534c1)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:53.533025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:53.538343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ead4-8977-426b-96fd-f175ee586393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:53.541193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ead4-8977-426b-96fd-f175ee586393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.541484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ead4-8977-426b-96fd-f175ee586393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.548095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ead4-8977-426b-96fd-f175ee586393 admin admin] PATH_INFO: `/v3/projects/c285d61e5c934ad99543ca8a57ba1fda/users/69da7d02e964465c844857edfa4fa4df/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.596274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54ead4-8977-426b-96fd-f175ee586393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c285d61e5c934ad99543ca8a57ba1fda, user_id=69da7d02e964465c844857edfa4fa4df, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:53.600363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54ead4-8977-426b-96fd-f175ee586393 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:53.647474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 844/1682] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:53 2022] PUT /identity/v3/projects/c285d61e5c934ad99543ca8a57ba1fda/users/69da7d02e964465c844857edfa4fa4df/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:53.660347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.660347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.660643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.698752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dd5c74897444b2a3716911c5e534c1', 'request_id': 'req-1329de17-7945-484e-8c9a-8313c7ec1b27'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:53.720305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dd5c74897444b2a3716911c5e534c1', 'request_id': 'req-1329de17-7945-484e-8c9a-8313c7ec1b27'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:53.728089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dd5c74897444b2a3716911c5e534c1', 'request_id': 'req-1329de17-7945-484e-8c9a-8313c7ec1b27'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:53.746658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] MFA Rules not processed for user `69da7d02e964465c844857edfa4fa4df`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:53.747990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:53.750902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] The token cache is being invalidate because project 54dd5c74897444b2a3716911c5e534c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:42:53.751568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:53.753560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1329de17-7945-484e-8c9a-8313c7ec1b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:53.780441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 839/1683] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:42:53 2022] DELETE /identity/v3/projects/54dd5c74897444b2a3716911c5e534c1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:42:53.788176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3d91-a2ab-41b8-a4f1-84f6f5ffed14 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:53.788767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3d91-a2ab-41b8-a4f1-84f6f5ffed14 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:53.789245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3d91-a2ab-41b8-a4f1-84f6f5ffed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:53.847954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-144b3d91-a2ab-41b8-a4f1-84f6f5ffed14 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:53.858519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-144b3d91-a2ab-41b8-a4f1-84f6f5ffed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:53.916156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 845/1684] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:42:53.935783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:53.937389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:54.004904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 840/1685] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:54.013249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.013996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.014621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.038401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c01a7-266d-4617-b03f-79f65fc733f6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.052075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:54.053539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:54.055057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.057327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.057624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.057906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.078486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 841/1686] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:54.082333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.084621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.088312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.095390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee30dfe-74a3-4804-b538-35d7a1424001 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.110455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 846/1687] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:54.122861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.123852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.124337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.124828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.128987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:54.129570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.132034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.157201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.159376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:54.190786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 842/1688] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:42:54.192045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.210115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce962b-1bd2-4b21-8def-84e0851becde service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.224148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effddb9-fdcc-442e-98c5-ef720f206a6b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.237530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.238980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.239702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.240352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.240925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.241655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.242252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.242668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.243183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] PATH_INFO: `/v3/users/69da7d02e964465c844857edfa4fa4df` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.245147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.245601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=69da7d02e964465c844857edfa4fa4df)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.247920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.360252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 843/1689] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:54 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:54.363272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69da7d02e964465c844857edfa4fa4df'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:54.364452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.404345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69da7d02e964465c844857edfa4fa4df'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:54.423518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69da7d02e964465c844857edfa4fa4df'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:54.424346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69da7d02e964465c844857edfa4fa4df'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:54.436804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1e022f59-db88-437b-b621-16288aa19f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69da7d02e964465c844857edfa4fa4df'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:54.459480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 847/1690] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:42:54 2022] DELETE /identity/v3/users/69da7d02e964465c844857edfa4fa4df => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:54.464065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.464574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.464904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.469011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257bf3-b038-4b41-b14c-ccbc97ff1dec admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.520965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:54.524955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:54.531177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.532414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.532708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.533356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.534126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.536593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.548771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 848/1691] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:54.567182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 844/1692] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:54 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:54.573617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.578553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:54.621990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b205-71cb-42c7-8115-6b27b4994853 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.628910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.631192 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:54.647987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.648789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.649149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.649493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.650300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.656134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.697053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 849/1693] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:42:54.701890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.746554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7adba-3ddd-4a43-aa77-a4f301e075f3 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.767440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.771918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.772343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.772725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.773580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.780637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.801523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d2f5f-977f-4528-a42b-6b0919868ad4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.816571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620f51d-e559-49ea-8a48-43d6fcc83514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.817271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620f51d-e559-49ea-8a48-43d6fcc83514 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.817562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620f51d-e559-49ea-8a48-43d6fcc83514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.817842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620f51d-e559-49ea-8a48-43d6fcc83514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.824665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 850/1694] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:54.829377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:54.846827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620f51d-e559-49ea-8a48-43d6fcc83514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.851251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620f51d-e559-49ea-8a48-43d6fcc83514 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:54.877762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f5c82-ec9b-429e-9f84-a63ddcb5d440 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:54.898264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:54.899888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 845/1695] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:54.904797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:54.905205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:54.906037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] PATH_INFO: `/v3/projects/7158b56c71ce4564bf36e7d4126d0a22/users/7bb00da246b24ec5b0fbcac3923e8f21/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:54.949431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7158b56c71ce4564bf36e7d4126d0a22, user_id=7bb00da246b24ec5b0fbcac3923e8f21, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:54.954241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:55.021294 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 851/1696] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:54 2022] PUT /identity/v3/projects/7158b56c71ce4564bf36e7d4126d0a22/users/7bb00da246b24ec5b0fbcac3923e8f21/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:55.031650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:55.036291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:55.036961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:55.105443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] MFA Rules not processed for user `7bb00da246b24ec5b0fbcac3923e8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:55.105443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:55.266859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 846/1697] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:55.271165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:55.397924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e805d-cb47-4cac-a51c-e12c8632a965 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:55.408389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:55.410452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:55.411223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:55.411861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:55.412888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:55.416363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:55.556298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:55.569078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 852/1698] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:55 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:55.574821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052d4be-7740-4595-98c8-aef6c1f7a190 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:55.760500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:55.766683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:55.776613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:55.781533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:55.782152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:55.782695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:55.783659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:55.786000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:55.803454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aaa4f-57b5-4e4d-9b94-4814201783db admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:55.832485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:55.834207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 847/1699] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:55 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:55.838165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:55.840618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:55.841429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:55.846116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] PATH_INFO: `/v3/projects/63fc0e8c62a349618e4cce8fd83020e6` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:55.852702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fc0e8c62a349618e4cce8fd83020e6)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:55.855903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ff99-58ce-4f99-a059-42b9bc448cde admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:55.861306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:55.867423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:55.868587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:55.869083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:55.869614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:55.870619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:55.874870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:55.887199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 848/1700] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:42:55.892480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:55.924864 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aa8de-71fd-4d40-bf01-74668bdd9f4c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:55.940710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:55.941858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:55.942288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:55.942678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] PATH_INFO: `/v3/projects/bf70e6b0f17a41aa8b061f34c8462e8f/users/44c2b29c73fd484ca74f89053e238508/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.003874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf70e6b0f17a41aa8b061f34c8462e8f, user_id=44c2b29c73fd484ca74f89053e238508, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.005472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fc0e8c62a349618e4cce8fd83020e6', 'request_id': 'req-fbcf03a1-247c-4232-98c7-4e2c574e66e5'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:56.011307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.024116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fc0e8c62a349618e4cce8fd83020e6', 'request_id': 'req-fbcf03a1-247c-4232-98c7-4e2c574e66e5'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:56.037462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fc0e8c62a349618e4cce8fd83020e6', 'request_id': 'req-fbcf03a1-247c-4232-98c7-4e2c574e66e5'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:56.044858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 849/1701] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:55 2022] PUT /identity/v3/projects/bf70e6b0f17a41aa8b061f34c8462e8f/users/44c2b29c73fd484ca74f89053e238508/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:42:56.049754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.082574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] The token cache is being invalidate because project 63fc0e8c62a349618e4cce8fd83020e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:42:56.082875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:56.083520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fbcf03a1-247c-4232-98c7-4e2c574e66e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:56.088998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 853/1702] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:42:55 2022] DELETE /identity/v3/projects/63fc0e8c62a349618e4cce8fd83020e6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:56.096928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7198f9-8583-46d3-81c3-9aa774ae4be8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.097381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7198f9-8583-46d3-81c3-9aa774ae4be8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.098159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7198f9-8583-46d3-81c3-9aa774ae4be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.133436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9f7198f9-8583-46d3-81c3-9aa774ae4be8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:56.136663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9f7198f9-8583-46d3-81c3-9aa774ae4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:56.218275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf14f7-7247-4063-a98e-86fa3e672563 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.244235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.244937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.245222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.245497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.251447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.253205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.280135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 854/1703] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:56.281612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.281907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.282189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.285693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 850/1704] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:56.288813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.290795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:56.321550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b4b8e-9da6-4142-be1e-25ad46615302 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.324575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:56.326377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:56.330049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.331085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.331394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.331661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] PATH_INFO: `/v3/projects/bf70e6b0f17a41aa8b061f34c8462e8f/users/44c2b29c73fd484ca74f89053e238508/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.334046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf70e6b0f17a41aa8b061f34c8462e8f, user_id=44c2b29c73fd484ca74f89053e238508, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.334943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 855/1705] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:56.339236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.341718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.349249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16414ae-811a-4945-920d-669bbcef4c44 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.354503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.355240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.355530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.355810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.356579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:56.356894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.358667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5354c2-44ad-4365-b6b8-3895360df08a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.376524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 851/1706] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:56 2022] PUT /identity/v3/projects/bf70e6b0f17a41aa8b061f34c8462e8f/users/44c2b29c73fd484ca74f89053e238508/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:42:56.384215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 856/1707] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:42:56.384546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.390073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.390356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.390903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.443248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] MFA Rules not processed for user `44c2b29c73fd484ca74f89053e238508`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:56.444487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:56.531762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497510-51be-41c3-9ba0-abc95fb36d2c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.548683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72433159-95dc-4c16-8357-4e32e352ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.549520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72433159-95dc-4c16-8357-4e32e352ff53 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.550744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72433159-95dc-4c16-8357-4e32e352ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.550744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72433159-95dc-4c16-8357-4e32e352ff53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.550744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72433159-95dc-4c16-8357-4e32e352ff53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.556569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72433159-95dc-4c16-8357-4e32e352ff53 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.628738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 852/1708] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:56 2022] POST /identity/v3/projects => generated 367 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:56.630997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.631814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.632305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.649800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 857/1709] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:56.650729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.654528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:56.655874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:56.692448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6df72-69c7-4182-a84a-56a3dd67384e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.739087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 853/1710] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:56.740011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.741350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:56.839740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d883c-e969-4595-8830-6d6f0e00b3c6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.847050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.847951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.848380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.848672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.862741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.863470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.865206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.865505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.869204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.873026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.930016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 858/1711] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:56 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:56.932744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:56.949702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.951578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:56.954349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783d9c4-da3c-4395-a032-88e024fb994e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:56.966340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 854/1712] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:42:56.979976 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:56.980994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:56.982223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:56.982223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:56.982822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:56.984470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:57.027899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 859/1713] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:57.031736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:57.053132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:57.054207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39575b4a-9139-4e54-8665-2dca17755ed6 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:57.067751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:57.069821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.070828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.071243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.072412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05bcc-e969-4a1e-bc47-66536a99de2a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:57.073413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:57.077441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:57.085247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:57.085937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.091723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.092120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.095467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:57.113115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 855/1714] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:57.116118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:57.152248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ae24-0119-4d9f-b18a-4f12dd47a377 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:57.181058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8070ad-4ea9-4e67-9554-e5ee8dc5f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:57.181414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8070ad-4ea9-4e67-9554-e5ee8dc5f7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.181715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8070ad-4ea9-4e67-9554-e5ee8dc5f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.181995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8070ad-4ea9-4e67-9554-e5ee8dc5f7c1 admin admin] PATH_INFO: `/v3/projects/b4517316879b42dbbc70b851bf9784ac/users/90329ace9b234bd4a7f2d28f889b8c17/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.224946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:57.227288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:57.229673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8070ad-4ea9-4e67-9554-e5ee8dc5f7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4517316879b42dbbc70b851bf9784ac, user_id=90329ace9b234bd4a7f2d28f889b8c17, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:57.240863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8070ad-4ea9-4e67-9554-e5ee8dc5f7c1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:57.259082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 860/1715] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:42:57.262458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:57.270619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:57.283055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 856/1716] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:57 2022] PUT /identity/v3/projects/b4517316879b42dbbc70b851bf9784ac/users/90329ace9b234bd4a7f2d28f889b8c17/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:57.297271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.298865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.301171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.367657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] MFA Rules not processed for user `90329ace9b234bd4a7f2d28f889b8c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:57.370976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:57.380328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2102ca-04c2-40cd-93a5-dd518052dcbc service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:57.499439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:57.500114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.500403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.500752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.585791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:57.589729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:57.594456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 857/1717] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:57.600094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:57.617479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 861/1718] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:42:57.742908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:57.744593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:57.937346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa28d-0b4f-40a1-a016-f74ce3dd2336 service swift] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:57.940191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3dd59-9dd7-45fd-99a0-4c662c37a1f5 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:57.951527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:57.952869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.953461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.953939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] PATH_INFO: `/v3/projects/c285d61e5c934ad99543ca8a57ba1fda` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.954227 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:57.956537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:57.957491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c285d61e5c934ad99543ca8a57ba1fda)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:57.957631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:57.957871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:57.960444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:57.961216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:57.968617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.063588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 858/1719] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:57 2022] POST /identity/v3/projects => generated 369 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:42:58.068827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.093315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c285d61e5c934ad99543ca8a57ba1fda', 'request_id': 'req-ab4e5870-68d9-48df-828f-57a88335e242'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:58.120614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c285d61e5c934ad99543ca8a57ba1fda', 'request_id': 'req-ab4e5870-68d9-48df-828f-57a88335e242'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:58.127726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c285d61e5c934ad99543ca8a57ba1fda', 'request_id': 'req-ab4e5870-68d9-48df-828f-57a88335e242'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:58.155305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] The token cache is being invalidate because project c285d61e5c934ad99543ca8a57ba1fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:42:58.155760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:58.159533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ab4e5870-68d9-48df-828f-57a88335e242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:42:58.161830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 862/1720] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:42:57 2022] DELETE /identity/v3/projects/c285d61e5c934ad99543ca8a57ba1fda => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:58.166744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c186-24a1-4eb6-8a0e-e4a98620bb88 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.168732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c186-24a1-4eb6-8a0e-e4a98620bb88 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.169263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c186-24a1-4eb6-8a0e-e4a98620bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.172869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a328-1a51-479a-a96f-517fa7a4833e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.181118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.182226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.182701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.183139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.185396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.187749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.219100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5cf6c186-24a1-4eb6-8a0e-e4a98620bb88 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:58.220631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5cf6c186-24a1-4eb6-8a0e-e4a98620bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:58.240775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 863/1721] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:42:58.250085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.250291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 859/1722] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:58 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:58.250815 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.251459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.253415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.258479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:58.288020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:58.289800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:58.312857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 864/1723] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:42:58.316618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.320205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742082-69fb-491a-a10f-22529c5016a5 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.335972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d057b5-1a1c-4327-ad2f-df9802e48768 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.349129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.350295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.350295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.350526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.350800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.351067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.351382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.352242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.352359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:42:58.352359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.354962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.363039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.374799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.392940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 865/1724] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:42:58.408133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.429549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687590bc-c4aa-4925-a3de-dfe3e9fd5424 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.433941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 860/1725] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:58.436298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.444108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.445106 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.445643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.446134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.447058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.449572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.493796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d3377-743e-4e2c-8f23-cd6ea6d5a750 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.517383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 866/1726] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:42:58 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:58.531596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.531776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.533529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.533820 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.543416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] PATH_INFO: `/v3/projects/e84042d53c98497e9052648112b21fc5/users/90046d24f52841ba951db63ce1951bbb/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.592401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84042d53c98497e9052648112b21fc5, user_id=90046d24f52841ba951db63ce1951bbb, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.597188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.665015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b364b-09ac-4430-886e-2e88b0902eae admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.683001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 861/1727] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:58 2022] PUT /identity/v3/projects/e84042d53c98497e9052648112b21fc5/users/90046d24f52841ba951db63ce1951bbb/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:58.688177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.801314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.802182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.802986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.803181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.804509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.806682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.877738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 867/1728] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:42:58 2022] POST /identity/v3/users => generated 288 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:42:58.879836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:58.905792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283deb3-cd6a-4b19-8638-5625ec276591 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.924017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895ce4-a621-4ba4-9277-4a78a7f2adf9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:58.931845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.932759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.933076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.933405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.934252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.936764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.958940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:58.960946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:58.963128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:58.965912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:58.966846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:58.969293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:58.982658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 862/1729] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:58.983636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:59.014073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 868/1730] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:59.014519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752237-a6d0-4c0a-a99b-a566b02fdf5e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:59.015567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:59.043467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2933a-6155-4b8b-9ef6-f372a1b9018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:59.047053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2933a-6155-4b8b-9ef6-f372a1b9018d admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:59.049258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2933a-6155-4b8b-9ef6-f372a1b9018d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:59.049557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2933a-6155-4b8b-9ef6-f372a1b9018d admin admin] PATH_INFO: `/v3/projects/e84042d53c98497e9052648112b21fc5/users/90046d24f52841ba951db63ce1951bbb/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:59.057034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2933a-6155-4b8b-9ef6-f372a1b9018d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84042d53c98497e9052648112b21fc5, user_id=90046d24f52841ba951db63ce1951bbb, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:59.067325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2933a-6155-4b8b-9ef6-f372a1b9018d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:59.080887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b197b59-f98f-4316-8554-d888d85999e0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:59.114145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:59.118099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:59.119482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 863/1731] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:58 2022] PUT /identity/v3/projects/e84042d53c98497e9052648112b21fc5/users/90046d24f52841ba951db63ce1951bbb/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:59.129368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:59.132543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:59.132690 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:59.132876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:59.133156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:59.134676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:59.138222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:59.194299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 869/1732] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:42:59.207622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:59.239858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] MFA Rules not processed for user `90046d24f52841ba951db63ce1951bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:59.241103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:59.250667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6912-abb8-47d6-ae3a-40eadc3ae2aa admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:59.442247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599a5bf-e73f-417a-9b7f-5187013d02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:59.445003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a5bf-e73f-417a-9b7f-5187013d02d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:59.446101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a5bf-e73f-417a-9b7f-5187013d02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:59.447487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a5bf-e73f-417a-9b7f-5187013d02d7 admin admin] PATH_INFO: `/v3/projects/4f575ce767d447119b8ce346f778ffd4/users/1a8ec23987df40f3868f12381807c642/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:59.508328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599a5bf-e73f-417a-9b7f-5187013d02d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f575ce767d447119b8ce346f778ffd4, user_id=1a8ec23987df40f3868f12381807c642, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:42:59.514020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599a5bf-e73f-417a-9b7f-5187013d02d7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:42:59.568498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 870/1733] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:42:59 2022] PUT /identity/v3/projects/4f575ce767d447119b8ce346f778ffd4/users/1a8ec23987df40f3868f12381807c642/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:42:59.580977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457c2c-2df5-4d2e-a3ba-705d5eabaace None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:59.581451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457c2c-2df5-4d2e-a3ba-705d5eabaace None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:59.581955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c457c2c-2df5-4d2e-a3ba-705d5eabaace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:59.616706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 864/1734] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:42:59.632406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:42:59.641195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:59.697716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6c457c2c-2df5-4d2e-a3ba-705d5eabaace None None] MFA Rules not processed for user `1a8ec23987df40f3868f12381807c642`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:42:59.699415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6c457c2c-2df5-4d2e-a3ba-705d5eabaace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:42:59.738534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af0f7d-8b25-4b4b-abab-d1692859fcd4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:42:59.831167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:42:59.831962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:42:59.832246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:42:59.835454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:42:59.952429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 871/1735] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:42:59.992997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:00.001868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:00.008430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:00.008956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:00.009379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:00.033970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 865/1736] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:42:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:00.034956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:00.040265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:00.072413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3822f-5327-4e10-9a47-43e57f807e7b service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:00.089108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8d79-0603-428f-a05f-6f22230d96a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:00.098638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] MFA Rules not processed for user `c9a4f5ac438741bcad2867f46c4dfaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:00.099930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8d79-0603-428f-a05f-6f22230d96a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:00.101046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:00.102773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8d79-0603-428f-a05f-6f22230d96a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:00.103492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8d79-0603-428f-a05f-6f22230d96a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:00.172630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e8d79-0603-428f-a05f-6f22230d96a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:00.181513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e8d79-0603-428f-a05f-6f22230d96a0 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:00.223668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 866/1737] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:00.250450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:00.250810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:00.251091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:00.290861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 872/1738] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:00.295203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:00.297582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:00.305359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:00.306743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:00.495809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 867/1739] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Apr 29 18:43:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:00.584727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9285ed9-51f2-4059-8a48-c7497bd76128 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:00.598560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9e89-8221-41ef-8298-0dd9e317f5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:00.599663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9e89-8221-41ef-8298-0dd9e317f5f0 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:00.599954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9e89-8221-41ef-8298-0dd9e317f5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:00.600277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9e89-8221-41ef-8298-0dd9e317f5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:00.620354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:00.622049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:00.635211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9e89-8221-41ef-8298-0dd9e317f5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:00.642349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9e89-8221-41ef-8298-0dd9e317f5f0 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:00.645031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd3adf-0b33-49f1-b6c3-71a0788fe56b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:00.660974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35873b65-2fe7-4cff-bea2-c18046b7e3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:00.661671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35873b65-2fe7-4cff-bea2-c18046b7e3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:00.665774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35873b65-2fe7-4cff-bea2-c18046b7e3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:00.667657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35873b65-2fe7-4cff-bea2-c18046b7e3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:00.696085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 873/1740] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:00.714863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35873b65-2fe7-4cff-bea2-c18046b7e3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:00.718673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35873b65-2fe7-4cff-bea2-c18046b7e3b7 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:00.759093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 868/1741] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:03.940499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a994a0-6ef0-4293-9356-e72a0fb0adfa None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:03.941064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a994a0-6ef0-4293-9356-e72a0fb0adfa None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:03.941064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a994a0-6ef0-4293-9356-e72a0fb0adfa None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:03.948200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 874/1742] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:43:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:43:04.073150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:04.073804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:04.073804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:04.181139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:04.186903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:04.230145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 869/1743] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:43:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:04.332700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a994a0-6ef0-4293-9356-e72a0fb0adfa None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:04.334937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e8a994a0-6ef0-4293-9356-e72a0fb0adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:04.388728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a994a0-6ef0-4293-9356-e72a0fb0adfa None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:04.397349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e0bb6-1096-428e-9b30-30dd2c6ae3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:04.398266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e0bb6-1096-428e-9b30-30dd2c6ae3b8 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:04.398594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e0bb6-1096-428e-9b30-30dd2c6ae3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:04.399370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e0bb6-1096-428e-9b30-30dd2c6ae3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:04.420557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e0bb6-1096-428e-9b30-30dd2c6ae3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:04.424708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e0bb6-1096-428e-9b30-30dd2c6ae3b8 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:04.466908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 875/1744] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:05.190255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:05.192317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:05.414425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caae6f-c3dd-44b7-94da-740c9ca7e106 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:05.431411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:05.435758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:05.443367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:05.443857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] PATH_INFO: `/v3/users/7bb00da246b24ec5b0fbcac3923e8f21` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:05.445520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb00da246b24ec5b0fbcac3923e8f21)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:05.454656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:05.595259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb00da246b24ec5b0fbcac3923e8f21'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:05.626620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb00da246b24ec5b0fbcac3923e8f21'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:05.647534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb00da246b24ec5b0fbcac3923e8f21'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:05.648212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb00da246b24ec5b0fbcac3923e8f21'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:05.648916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb00da246b24ec5b0fbcac3923e8f21'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:05.686333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:05.687023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:05.687023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:05.692859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 870/1745] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:05 2022] DELETE /identity/v3/users/7bb00da246b24ec5b0fbcac3923e8f21 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:05.746214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:05.752670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:05.944669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 876/1746] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:06.002389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:06.005341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:06.154220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef7d7-772c-4a46-9863-8e2a27c275a0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:06.169648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97134de-1584-4065-b4b5-f11ce9c37efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:06.170854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97134de-1584-4065-b4b5-f11ce9c37efd service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:06.171244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97134de-1584-4065-b4b5-f11ce9c37efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:06.171592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97134de-1584-4065-b4b5-f11ce9c37efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:06.205700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97134de-1584-4065-b4b5-f11ce9c37efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:06.215265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97134de-1584-4065-b4b5-f11ce9c37efd service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:06.245699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 871/1747] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:06.572137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:06.573646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:06.595557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3bf84-d486-4951-b119-3f5e329b2811 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:06.622655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:06.623607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:06.623902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:06.624167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] PATH_INFO: `/v3/users/90329ace9b234bd4a7f2d28f889b8c17` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:06.625995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90329ace9b234bd4a7f2d28f889b8c17)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:06.630287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:06.758834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90329ace9b234bd4a7f2d28f889b8c17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:06.807997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90329ace9b234bd4a7f2d28f889b8c17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:06.824558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90329ace9b234bd4a7f2d28f889b8c17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:06.825511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90329ace9b234bd4a7f2d28f889b8c17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:06.854363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90329ace9b234bd4a7f2d28f889b8c17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:06.874593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 877/1748] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:06 2022] DELETE /identity/v3/users/90329ace9b234bd4a7f2d28f889b8c17 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:06.876728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:06.877036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:06.877671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:06.930642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:06.932073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:07.081537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 872/1749] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:07.181937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:07.185143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:07.377599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d519c-ccba-4fd6-b381-30fc85b9c049 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:07.398534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:07.399570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:07.400035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:07.403600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:07.468354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:07.469843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:07.508396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 878/1750] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:08.320685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:08.322236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:08.350740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e462-3753-4b00-b184-88ea154e9517 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:08.378987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:08.379947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:08.380252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:08.380532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] PATH_INFO: `/v3/projects/7158b56c71ce4564bf36e7d4126d0a22` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:08.383495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7158b56c71ce4564bf36e7d4126d0a22)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:08.390048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:08.521273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7158b56c71ce4564bf36e7d4126d0a22', 'request_id': 'req-f29fa1e2-2364-4227-9b75-aa5b31068e9b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.538659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7158b56c71ce4564bf36e7d4126d0a22', 'request_id': 'req-f29fa1e2-2364-4227-9b75-aa5b31068e9b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.549469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7158b56c71ce4564bf36e7d4126d0a22', 'request_id': 'req-f29fa1e2-2364-4227-9b75-aa5b31068e9b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.572261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] The token cache is being invalidate because project 7158b56c71ce4564bf36e7d4126d0a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:08.576112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.587643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f29fa1e2-2364-4227-9b75-aa5b31068e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.591213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 873/1751] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:08 2022] DELETE /identity/v3/projects/7158b56c71ce4564bf36e7d4126d0a22 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:08.595286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:08.613244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4eb29-e4af-4a32-82c5-265361020ff7 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:08.783644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:08.784545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:08.784827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:08.790903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] PATH_INFO: `/v3/users/44c2b29c73fd484ca74f89053e238508` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:08.804701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2b29c73fd484ca74f89053e238508)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:08.806802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:08.901573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2b29c73fd484ca74f89053e238508'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.923298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2b29c73fd484ca74f89053e238508'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.938994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2b29c73fd484ca74f89053e238508'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.940219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2b29c73fd484ca74f89053e238508'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.954554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2b29c73fd484ca74f89053e238508'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:08.967293 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 879/1752] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:08 2022] DELETE /identity/v3/users/44c2b29c73fd484ca74f89053e238508 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:09.247317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:09.247910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:09.248265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:09.249203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:09.249287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:09.344839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] MFA Rules not processed for user `aeea9d59c41341db8496a2c63d8655fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:09.368415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:09.433822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462a24e-c143-4250-b523-d0a43c270103 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:09.468746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:09.469750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:09.470048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:09.477642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] PATH_INFO: `/v3/projects/b4517316879b42dbbc70b851bf9784ac` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:09.490299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4517316879b42dbbc70b851bf9784ac)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:09.492449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:09.643778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4517316879b42dbbc70b851bf9784ac', 'request_id': 'req-e4e25c31-d32b-4eb8-860e-4b525e07c059'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:09.672907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4517316879b42dbbc70b851bf9784ac', 'request_id': 'req-e4e25c31-d32b-4eb8-860e-4b525e07c059'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:09.696640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4517316879b42dbbc70b851bf9784ac', 'request_id': 'req-e4e25c31-d32b-4eb8-860e-4b525e07c059'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:09.706051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 874/1753] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:09.719332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:09.723779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:09.769042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] The token cache is being invalidate because project b4517316879b42dbbc70b851bf9784ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:09.769864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:09.777094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:09.786708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 880/1754] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:09 2022] DELETE /identity/v3/projects/b4517316879b42dbbc70b851bf9784ac => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:09.792266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:09.797795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:09.923187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab9f5-85f0-4ff0-9ca5-7db9a39c7ee3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:10.021633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e25c31-d32b-4eb8-860e-4b525e07c059 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:10.051572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:10.056191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:10.056191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:10.056191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] PATH_INFO: `/v3/users/90046d24f52841ba951db63ce1951bbb` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:10.062891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90046d24f52841ba951db63ce1951bbb)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:10.070676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:10.179038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:10.180061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:10.180769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:10.183445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:10.189014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:10.221069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90046d24f52841ba951db63ce1951bbb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.275894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90046d24f52841ba951db63ce1951bbb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.303215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90046d24f52841ba951db63ce1951bbb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.304745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90046d24f52841ba951db63ce1951bbb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.327349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bac3155f-c6bb-4e74-8a66-40f147cc3be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90046d24f52841ba951db63ce1951bbb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.354321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 881/1755] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:09 2022] DELETE /identity/v3/users/90046d24f52841ba951db63ce1951bbb => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:10.354321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14f6e-ba2e-4224-9a35-69aeac57912d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:10.354321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14f6e-ba2e-4224-9a35-69aeac57912d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:10.354321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14f6e-ba2e-4224-9a35-69aeac57912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:10.427052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:10.443650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:10.491386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7af14f6e-ba2e-4224-9a35-69aeac57912d None None] MFA Rules not processed for user `7f0abeff2be84d51854bd3231864669e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:10.491964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 875/1756] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:10.493446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7af14f6e-ba2e-4224-9a35-69aeac57912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:10.494617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:10.501311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:10.561999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662011-be8b-44c6-9ecb-74f64c5c75c1 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:10.794989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 882/1757] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:10.845139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:10.850412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:10.853988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:10.854352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] PATH_INFO: `/v3/projects/bf70e6b0f17a41aa8b061f34c8462e8f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:10.856062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf70e6b0f17a41aa8b061f34c8462e8f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:10.858334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:10.951209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf70e6b0f17a41aa8b061f34c8462e8f', 'request_id': 'req-d4d5a66f-ddd9-4758-bc40-fe5895364a00'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.993611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf70e6b0f17a41aa8b061f34c8462e8f', 'request_id': 'req-d4d5a66f-ddd9-4758-bc40-fe5895364a00'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:10.996485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:10.997668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:10.998621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.010059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf70e6b0f17a41aa8b061f34c8462e8f', 'request_id': 'req-d4d5a66f-ddd9-4758-bc40-fe5895364a00'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:11.037403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] The token cache is being invalidate because project bf70e6b0f17a41aa8b061f34c8462e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:11.037761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:11.040153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d4d5a66f-ddd9-4758-bc40-fe5895364a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:11.042584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 876/1758] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:10 2022] DELETE /identity/v3/projects/bf70e6b0f17a41aa8b061f34c8462e8f => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:11.048477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6fdb0-ab36-4539-924e-d4ae4d31aef1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.048778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6fdb0-ab36-4539-924e-d4ae4d31aef1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.049084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6fdb0-ab36-4539-924e-d4ae4d31aef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.050336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] MFA Rules not processed for user `c9a4f5ac438741bcad2867f46c4dfaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:11.058087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:11.128058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5fb6fdb0-ab36-4539-924e-d4ae4d31aef1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:11.131876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5fb6fdb0-ab36-4539-924e-d4ae4d31aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:11.248612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 883/1759] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:11.250371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.254162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:11.298473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 877/1760] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:11.307275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.308104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.308591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.393209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:11.409470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:11.449904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 878/1761] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:11.455469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.488180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ef96e-7f49-44f4-aa9d-8f4f3d34ad50 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:11.497846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57df77d-a841-45e3-8fd2-8260dfb75536 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:11.501365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:11.502955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.503481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.504098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.505353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:11.505859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:11.507819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:11.524840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 879/1762] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:11.525493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:11.526168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.526453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.526730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.531708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.531856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:11.558922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5cc5c-077e-4970-a803-2cf9d0dad010 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:11.572541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:11.573109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.574840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.575216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.578007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:11.581452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:11.656090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 880/1763] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:11 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:11.663430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.776946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:11.779191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:11.809651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 884/1764] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:11.810673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.811458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb91f-9b93-4a8b-9f22-18afe796bff0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:11.816433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:11.820074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:11.821247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.821700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.822222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.823071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:11.827635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:11.866843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 881/1765] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:11 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:11.869167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.889066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d073e2-fdd3-4fa4-a7b2-6cf24a5f1ecf service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:11.891197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759f1e5-c229-40bf-95c2-5985a2cf677b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:11.900004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:11.900863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.901297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.901672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.902575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:11.905777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:11.927333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 882/1766] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:11.929563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:11.940932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:11.944160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:11.947259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:11.947389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] PATH_INFO: `/v3/projects/e84042d53c98497e9052648112b21fc5` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:11.960348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84042d53c98497e9052648112b21fc5)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:11.972078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:11.976727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ba70-cd0e-4f18-9965-922bf5cbdee5 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:12.008359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:12.017048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.017910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.019936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.026989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:12.032915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:12.095555 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 883/1767] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:12.104634 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:12.136365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f682b-93bd-4dff-b99c-807401f77dec admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:12.191429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84042d53c98497e9052648112b21fc5', 'request_id': 'req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:12.205425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84042d53c98497e9052648112b21fc5', 'request_id': 'req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:12.220415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84042d53c98497e9052648112b21fc5', 'request_id': 'req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:12.251736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] The token cache is being invalidate because project e84042d53c98497e9052648112b21fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:12.252153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:12.254048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6cb4471e-ca4f-4ce2-a440-0975ff3d6c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:12.260993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 885/1768] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:11 2022] DELETE /identity/v3/projects/e84042d53c98497e9052648112b21fc5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:12.263759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be06ac-b0fe-4368-bd08-d168fe9e023d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.264064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be06ac-b0fe-4368-bd08-d168fe9e023d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.264343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be06ac-b0fe-4368-bd08-d168fe9e023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.328369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d0be06ac-b0fe-4368-bd08-d168fe9e023d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:12.330971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d0be06ac-b0fe-4368-bd08-d168fe9e023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:12.336964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a6375-6e36-45b4-933f-68773ac639f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:12.339465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a6375-6e36-45b4-933f-68773ac639f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.339702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a6375-6e36-45b4-933f-68773ac639f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.339987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a6375-6e36-45b4-933f-68773ac639f1 admin admin] PATH_INFO: `/v3/projects/9c42485e8eab4e4fac8228e555227019/users/c081653a30f34712ae448584ed5b932d/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.361336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 886/1769] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:12.361557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a6375-6e36-45b4-933f-68773ac639f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c42485e8eab4e4fac8228e555227019, user_id=c081653a30f34712ae448584ed5b932d, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:12.363141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.363265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a6375-6e36-45b4-933f-68773ac639f1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:12.363507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.363741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.404242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 884/1770] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:12 2022] PUT /identity/v3/projects/9c42485e8eab4e4fac8228e555227019/users/c081653a30f34712ae448584ed5b932d/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:12.408151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.409170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.410409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.411696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:12.416328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:12.522509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] MFA Rules not processed for user `c081653a30f34712ae448584ed5b932d`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:12.527181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:12.591604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 887/1771] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:12.595981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:12.609394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa3738-fd8d-4ec5-ae71-b894d5bd2f8c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:12.617277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:12.618328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.618929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.619775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.621333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:12.621998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:12.625491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:12.655632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 888/1772] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:12.657931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:12.671751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5e597-bebf-441a-ab92-a8567dbd4746 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:12.679278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:12.680655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.681213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.681757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.682929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:12.685800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:12.788515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 885/1773] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:12.789467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:12.795942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:12.871036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ed0c-5636-4540-a41d-199e0534bb70 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:12.898562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:12.899365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:12.899658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:12.899940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:12.900660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:12.902612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.006809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 889/1774] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:12 2022] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:13.013982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.029582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 886/1775] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:12 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:13.038289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.190685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb09c9-088c-4155-8215-8b0a370e41eb admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.265586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a933-c4c9-4651-9784-7085a804c0bf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.270940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.272120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.272537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.272980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.274268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.276468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.331363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 887/1776] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:13 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:13.339630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.349816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.350572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.350859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.351929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.352586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.357735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.375913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b222a3-5b00-488a-857f-8e2ba1a3b9bb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.383502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.384556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.385105 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.385571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.386455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.402935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.429217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 890/1777] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:13 2022] POST /identity/v3/users => generated 290 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:13.430439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.441122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 888/1778] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:13.443872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.455557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243e7d-d427-4730-adc9-042d45b315c0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.469964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.471566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.472018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.473854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.475194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.477142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.477946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbeed6-ff1a-456c-bdb7-7a69c1c15a23 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.494690 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 891/1779] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:13.496163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.500985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.502238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.502670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.503064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] PATH_INFO: `/v3/projects/d1e8eeff152c4bae95bfdcac364ef664/users/0b8bcc3fd2d54fa6ac40f430f5dec390/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.509144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83daa-70cc-4ed3-95c4-4d1568dd8cd9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.517953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.519057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.519488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.519898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.521312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.527348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.542200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 892/1780] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:13.564201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.564622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e8eeff152c4bae95bfdcac364ef664, user_id=0b8bcc3fd2d54fa6ac40f430f5dec390, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.585231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.617232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e643-22ea-4cc5-853d-c83a0839345b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.658302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde019-a93e-4a5c-b888-1d77368485b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.662313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 889/1781] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:13 2022] PUT /identity/v3/projects/d1e8eeff152c4bae95bfdcac364ef664/users/0b8bcc3fd2d54fa6ac40f430f5dec390/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:13.668475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde019-a93e-4a5c-b888-1d77368485b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.669395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:13.670323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde019-a93e-4a5c-b888-1d77368485b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.670820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde019-a93e-4a5c-b888-1d77368485b7 admin admin] PATH_INFO: `/v3/projects/4cf1fe715e3d49599cf1b1dcbc313de8/users/c90a491bf41244cb8d72af806651a0a6/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.743235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde019-a93e-4a5c-b888-1d77368485b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf1fe715e3d49599cf1b1dcbc313de8, user_id=c90a491bf41244cb8d72af806651a0a6, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.746586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde019-a93e-4a5c-b888-1d77368485b7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.809633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 893/1782] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:13 2022] PUT /identity/v3/projects/4cf1fe715e3d49599cf1b1dcbc313de8/users/c90a491bf41244cb8d72af806651a0a6/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:13.820572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.820897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.823087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.869288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01f448-11ab-459e-9394-f4f17369f3bb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:13.872011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] MFA Rules not processed for user `c90a491bf41244cb8d72af806651a0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:13.874153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:13.948819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:13.950825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:13.951388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:13.951620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:13.952944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:13.954743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:13.999306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 890/1783] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:14.000668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.002710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 894/1784] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:14.003637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.030565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503678-6f4d-4f88-a2a4-6f4062354ebc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.035805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.036875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.036875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.037054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.037791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.041514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.055601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8205-f0d8-4605-9999-9e71d144b5ac admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.073774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e5bc4-88ec-48e7-b6b2-a09554e1cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.075480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e5bc4-88ec-48e7-b6b2-a09554e1cd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.077337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e5bc4-88ec-48e7-b6b2-a09554e1cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.079330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e5bc4-88ec-48e7-b6b2-a09554e1cd36 admin admin] PATH_INFO: `/v3/projects/d1e8eeff152c4bae95bfdcac364ef664/users/0b8bcc3fd2d54fa6ac40f430f5dec390/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.086934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e5bc4-88ec-48e7-b6b2-a09554e1cd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e8eeff152c4bae95bfdcac364ef664, user_id=0b8bcc3fd2d54fa6ac40f430f5dec390, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.098934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e5bc4-88ec-48e7-b6b2-a09554e1cd36 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.111021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 891/1785] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:13 2022] PUT /identity/v3/projects/d1e8eeff152c4bae95bfdcac364ef664/users/0b8bcc3fd2d54fa6ac40f430f5dec390/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:14.125058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.125357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.125650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.128317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 895/1786] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:14 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:14.129834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.184910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] MFA Rules not processed for user `0b8bcc3fd2d54fa6ac40f430f5dec390`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:14.186364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:14.290758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005083f-e5b6-4350-b380-07c06ea07a22 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.301554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.308313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.308666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.309784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.312180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.315447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.355383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 896/1787] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:14 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:14.360662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.363285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 892/1788] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:14.374865 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.381356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:14.383760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24e81e-d91c-4191-a0e2-3e7e4da1d9f8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.393858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.394877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.395209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.395689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.398618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.401280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.423501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 897/1789] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:14.427854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.460199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79d511-933b-4e3e-a4c0-237229bea2c1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.474006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.475877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.476535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.476960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] PATH_INFO: `/v3/projects/b223d11115044ffe949b2ccab1326584/users/139d90a9a3e043ad9dbb79000b6c4c82/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.527421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d30e7-ee40-456b-aa85-6498bbb3e725 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.532339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b223d11115044ffe949b2ccab1326584, user_id=139d90a9a3e043ad9dbb79000b6c4c82, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.536534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.537214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.537511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.537795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.541150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.561311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.562903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.576758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 898/1790] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:14 2022] PUT /identity/v3/projects/b223d11115044ffe949b2ccab1326584/users/139d90a9a3e043ad9dbb79000b6c4c82/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:14.581520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.596187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 893/1791] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:14.633639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.652624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97ebe-4c08-4ca1-8854-eaa4b55e56b8 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.780288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.781285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.781579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.781895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] PATH_INFO: `/v3/users/c081653a30f34712ae448584ed5b932d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.787000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c081653a30f34712ae448584ed5b932d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.788135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159061-9168-499f-9ac2-59ec73a037a4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.791226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.814243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.815951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.816264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.816553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.819238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.824687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.860076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 899/1792] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:14.864932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:14.899788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f638d-5137-4f7f-88ec-973372be57fe admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:14.910150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27146ae4-ec77-4549-8b5e-e084d78d2c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:14.911045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146ae4-ec77-4549-8b5e-e084d78d2c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.911682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146ae4-ec77-4549-8b5e-e084d78d2c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.912038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146ae4-ec77-4549-8b5e-e084d78d2c96 admin admin] PATH_INFO: `/v3/projects/b223d11115044ffe949b2ccab1326584/users/139d90a9a3e043ad9dbb79000b6c4c82/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.921189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27146ae4-ec77-4549-8b5e-e084d78d2c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b223d11115044ffe949b2ccab1326584, user_id=139d90a9a3e043ad9dbb79000b6c4c82, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:14.924266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27146ae4-ec77-4549-8b5e-e084d78d2c96 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:14.929239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c081653a30f34712ae448584ed5b932d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:14.948707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 900/1793] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:14 2022] PUT /identity/v3/projects/b223d11115044ffe949b2ccab1326584/users/139d90a9a3e043ad9dbb79000b6c4c82/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:14.959089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:14.959452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:14.959713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:14.970735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c081653a30f34712ae448584ed5b932d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:14.997904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c081653a30f34712ae448584ed5b932d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:14.998554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c081653a30f34712ae448584ed5b932d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:14.999309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3b7ce23e-91c9-4093-a5bf-666b4a70a491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c081653a30f34712ae448584ed5b932d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:15.027425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] MFA Rules not processed for user `139d90a9a3e043ad9dbb79000b6c4c82`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:15.029680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:15.051394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 894/1794] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:14 2022] DELETE /identity/v3/users/c081653a30f34712ae448584ed5b932d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:15.060496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:15.060789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:15.061072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:15.156406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:15.157663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:15.256029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 901/1795] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:15.266299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:15.268533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:15.339057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 895/1796] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:15.414505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:15.416330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:15.419259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff924b9-4c7a-4d0d-ab1e-15289f841e28 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:15.573997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8a79-a6d3-4039-99c3-7f278f225465 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:15.576565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:15.579791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:15.581060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:15.581617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f116-b210-4b7b-bb85-c46da4427ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:15.581762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:15.582565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f116-b210-4b7b-bb85-c46da4427ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:15.583251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f116-b210-4b7b-bb85-c46da4427ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:15.583715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f116-b210-4b7b-bb85-c46da4427ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:15.588836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:15.595218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9f116-b210-4b7b-bb85-c46da4427ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:15.596894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9f116-b210-4b7b-bb85-c46da4427ea3 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:15.612762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 896/1797] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:15.794189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:15.794558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:15.794939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:15.796420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:15.800439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:15.823404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] MFA Rules not processed for user `aeea9d59c41341db8496a2c63d8655fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:15.826732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:15.829648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 902/1798] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:16.007999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 897/1799] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:17.030520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:17.035766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:17.059435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3727dd-0848-4fea-af49-cc87f3c1849f service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:17.065074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:17.066461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:17.066755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:17.067041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] PATH_INFO: `/v3/projects/9c42485e8eab4e4fac8228e555227019` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:17.068446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c42485e8eab4e4fac8228e555227019)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:17.075893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:17.133753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c42485e8eab4e4fac8228e555227019', 'request_id': 'req-f5cdb97a-7571-4903-a793-78f188b213b2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.144201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c42485e8eab4e4fac8228e555227019', 'request_id': 'req-f5cdb97a-7571-4903-a793-78f188b213b2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.149849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c42485e8eab4e4fac8228e555227019', 'request_id': 'req-f5cdb97a-7571-4903-a793-78f188b213b2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.167842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] The token cache is being invalidate because project 9c42485e8eab4e4fac8228e555227019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:17.168211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.169097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f5cdb97a-7571-4903-a793-78f188b213b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.170940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 903/1800] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:17 2022] DELETE /identity/v3/projects/9c42485e8eab4e4fac8228e555227019 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:17.176469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:17.191510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8431ca-0cd5-4900-b4f2-e91b12590ecf None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:17.200857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:17.210321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:17.210321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:17.225773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] MFA Rules not processed for user `7f0abeff2be84d51854bd3231864669e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:17.227292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:17.273478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:17.274366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:17.274648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:17.274923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] PATH_INFO: `/v3/users/0b8bcc3fd2d54fa6ac40f430f5dec390` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:17.276173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8bcc3fd2d54fa6ac40f430f5dec390)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:17.278671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:17.291668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 904/1801] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:17.331876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8bcc3fd2d54fa6ac40f430f5dec390'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.349030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8bcc3fd2d54fa6ac40f430f5dec390'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.356543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8bcc3fd2d54fa6ac40f430f5dec390'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.357224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8bcc3fd2d54fa6ac40f430f5dec390'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.357856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-622ee9b6-3ab1-4960-8a75-65c8faaaad02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8bcc3fd2d54fa6ac40f430f5dec390'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:17.371050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 898/1802] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:17 2022] DELETE /identity/v3/users/0b8bcc3fd2d54fa6ac40f430f5dec390 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:17.661898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:17.663951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:17.741748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044beec1-af74-4a82-8006-43729ac47e45 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:17.880070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:17.880803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:17.881093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:17.881371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:17.885211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:17.903072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2e7c-3a84-4ea5-896a-5d186b6a58e1 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:17.903632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2e7c-3a84-4ea5-896a-5d186b6a58e1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:17.904113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2e7c-3a84-4ea5-896a-5d186b6a58e1 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:17.906112 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 899/1803] 10.222.0.45 () {54 vars in 912 bytes} [Fri Apr 29 18:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:43:17.912818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:17.913348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:17.913827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:17.956263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:17.958570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:18.080882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:18.084430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:18.109391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 905/1804] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:18.110560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:18.121255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 900/1805] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:18.131514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:18.132795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:18.135446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:18.160288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ca50-2053-40ac-8603-01e4bfe17db5 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:18.174578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa631db-861b-4c5c-a9f0-0ea883ed1863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:18.175763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa631db-861b-4c5c-a9f0-0ea883ed1863 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.176556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa631db-861b-4c5c-a9f0-0ea883ed1863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.177450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa631db-861b-4c5c-a9f0-0ea883ed1863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.193186 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa631db-861b-4c5c-a9f0-0ea883ed1863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:18.199345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa631db-861b-4c5c-a9f0-0ea883ed1863 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:18.222293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 901/1806] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:18.281213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9ac8-53e9-4a50-8b3b-e990ec839005 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:18.294696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:18.295819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.296261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.296688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] PATH_INFO: `/v3/projects/d1e8eeff152c4bae95bfdcac364ef664` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.301126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e8eeff152c4bae95bfdcac364ef664)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:18.303144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:18.400593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e8eeff152c4bae95bfdcac364ef664', 'request_id': 'req-87d40f83-a754-4661-abf4-a5172880e754'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:18.414834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e8eeff152c4bae95bfdcac364ef664', 'request_id': 'req-87d40f83-a754-4661-abf4-a5172880e754'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:18.423041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e8eeff152c4bae95bfdcac364ef664', 'request_id': 'req-87d40f83-a754-4661-abf4-a5172880e754'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:18.447341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] The token cache is being invalidate because project d1e8eeff152c4bae95bfdcac364ef664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:18.447641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:18.451052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-87d40f83-a754-4661-abf4-a5172880e754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:18.454454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 906/1807] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:18 2022] DELETE /identity/v3/projects/d1e8eeff152c4bae95bfdcac364ef664 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:18.459638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.460348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.460779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.520078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:18.521241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:18.695025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 902/1808] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:18.696941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.697275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.697546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.729259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:18.731067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:18.741275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 907/1809] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:18.745813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:18.756876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82bec8-a558-460d-85e8-4d994c3e0d16 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:18.762823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:18.763757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.764203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.764525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.765277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:18.765590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:18.767536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:18.781559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 903/1810] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:18.787077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:18.796875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba2e03-c2b9-4d47-9fe9-863ff6186c29 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:18.802629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:18.803466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.803926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.804232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.804912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:18.806878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:18.834872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 908/1811] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:18 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:18.839673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:18.851813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29186d-b766-4eee-815a-4ef295738b46 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:18.940056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:18.941139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:18.942056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:18.942590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:18.943534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:18.945890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:18.990721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 904/1812] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:18 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:18.991807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.007221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834a347-36de-4c27-8710-8a52903bcc0b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.015521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.016674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.017180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.017689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.018530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.020295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.033649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 909/1813] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:19.037920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.050932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617e727-4a39-4e6f-a81d-ab5cf07d5c4f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.056296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c24b8-9238-4322-9cbc-5957c63fe372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.057712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c24b8-9238-4322-9cbc-5957c63fe372 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.058066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c24b8-9238-4322-9cbc-5957c63fe372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.058351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c24b8-9238-4322-9cbc-5957c63fe372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.059957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c24b8-9238-4322-9cbc-5957c63fe372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.061816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c24b8-9238-4322-9cbc-5957c63fe372 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.075754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 905/1814] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:19.080170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.116623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fa220-f542-48eb-a73a-e53567d4652f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.127520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.129472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.129785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.130374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] PATH_INFO: `/v3/projects/0380ad73d39c4870bac9365e5dc33b1d/users/ddf6093c259841a79615be1c24723e11/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.150784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0380ad73d39c4870bac9365e5dc33b1d, user_id=ddf6093c259841a79615be1c24723e11, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.154325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.171409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 910/1815] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:19 2022] PUT /identity/v3/projects/0380ad73d39c4870bac9365e5dc33b1d/users/ddf6093c259841a79615be1c24723e11/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:19.185368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096226-12c2-4674-827c-5569ff97046e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.185769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096226-12c2-4674-827c-5569ff97046e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.185958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096226-12c2-4674-827c-5569ff97046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.221492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-53096226-12c2-4674-827c-5569ff97046e None None] MFA Rules not processed for user `ddf6093c259841a79615be1c24723e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:19.222861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-53096226-12c2-4674-827c-5569ff97046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:19.289769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 906/1816] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:19.294738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.362434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307592d5-3459-4fe0-b440-11fecf63f845 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.368153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.368832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.369122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.369405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.370121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.372695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.402551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 911/1817] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:19 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:19.407055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53096226-12c2-4674-827c-5569ff97046e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.420305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53096226-12c2-4674-827c-5569ff97046e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.512521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.513463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.520819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.523061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.523610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.527622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.587137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 907/1818] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:19 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:19.588270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.599327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c37b-abab-4c13-8043-0179d3f55224 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.608931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.610821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.610944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.611691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.612861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.614834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.638437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.647673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 912/1819] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:19.651985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05f27-5b46-44d5-aee2-c2b19d250cf4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.659384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.660553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.661500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.662013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] PATH_INFO: `/v3/projects/b26b00a1efd5403dae4f9f0d4c07961e/users/6c43191325f34707b249b03dd28f0352/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.714812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26b00a1efd5403dae4f9f0d4c07961e, user_id=6c43191325f34707b249b03dd28f0352, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.718532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.748770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 908/1820] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:19 2022] PUT /identity/v3/projects/b26b00a1efd5403dae4f9f0d4c07961e/users/6c43191325f34707b249b03dd28f0352/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:19.753025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.768123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf7f3e-8699-442f-8bba-30b8513b535e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.875454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9883f-4e02-4031-a7fb-99c9ef7173ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.876485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9883f-4e02-4031-a7fb-99c9ef7173ee admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.876888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9883f-4e02-4031-a7fb-99c9ef7173ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.877264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9883f-4e02-4031-a7fb-99c9ef7173ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.878280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9883f-4e02-4031-a7fb-99c9ef7173ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.880195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9883f-4e02-4031-a7fb-99c9ef7173ee admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.893407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 913/1821] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:19.898807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:19.918649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd791e8-a854-4f0d-ad31-454263682dee admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:19.923895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:19.925035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.925510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.925961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] PATH_INFO: `/v3/projects/b26b00a1efd5403dae4f9f0d4c07961e/users/6c43191325f34707b249b03dd28f0352/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:19.928867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26b00a1efd5403dae4f9f0d4c07961e, user_id=6c43191325f34707b249b03dd28f0352, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:19.932321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:19.960737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 909/1822] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:19 2022] PUT /identity/v3/projects/b26b00a1efd5403dae4f9f0d4c07961e/users/6c43191325f34707b249b03dd28f0352/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:19.971344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:19.972280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:19.972280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:20.031018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] MFA Rules not processed for user `6c43191325f34707b249b03dd28f0352`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:20.032303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:20.205462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 914/1823] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:20.372872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:20.375525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:20.517842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0944f0-e8fb-42e7-b333-ca36a52bdc94 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:20.530380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f56be-9f8e-44bf-affa-aeb41b4b00ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:20.531068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f56be-9f8e-44bf-affa-aeb41b4b00ec service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:20.531491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f56be-9f8e-44bf-affa-aeb41b4b00ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:20.531854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f56be-9f8e-44bf-affa-aeb41b4b00ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:20.552672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f56be-9f8e-44bf-affa-aeb41b4b00ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:20.557155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:20.558489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f56be-9f8e-44bf-affa-aeb41b4b00ec service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:20.558969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:20.585582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 910/1824] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:20.675217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02033-f0cf-4869-b2c8-01190ad61071 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:20.683265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:20.685529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:20.686131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:20.686720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] PATH_INFO: `/v3/users/1a8ec23987df40f3868f12381807c642` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:20.689334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8ec23987df40f3868f12381807c642)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:20.692112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:20.781624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8ec23987df40f3868f12381807c642'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:20.801539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8ec23987df40f3868f12381807c642'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:20.814053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8ec23987df40f3868f12381807c642'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:20.815620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8ec23987df40f3868f12381807c642'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:20.825663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8ec23987df40f3868f12381807c642'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:20.833174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 915/1825] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:20 2022] DELETE /identity/v3/users/1a8ec23987df40f3868f12381807c642 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:20.838212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de824cc-beb0-480d-979d-768302da663a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:20.838509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de824cc-beb0-480d-979d-768302da663a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:20.839034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de824cc-beb0-480d-979d-768302da663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:20.861855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9de824cc-beb0-480d-979d-768302da663a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:20.863480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9de824cc-beb0-480d-979d-768302da663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:20.882380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:20.884150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:21.033556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 911/1826] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:21.035092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7a68-9abb-40ce-9f1a-bc1664ba52c8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:21.048943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:21.050839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:21.052226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:21.052226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:21.058409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:21.060086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de824cc-beb0-480d-979d-768302da663a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:21.063884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9de824cc-beb0-480d-979d-768302da663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:21.163951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:21.165574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:21.195271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 916/1827] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:21.211922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de824cc-beb0-480d-979d-768302da663a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:21.218945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2410d1-d149-4988-ad15-cb9aaa886c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:21.219849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2410d1-d149-4988-ad15-cb9aaa886c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:21.220284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2410d1-d149-4988-ad15-cb9aaa886c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:21.220734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2410d1-d149-4988-ad15-cb9aaa886c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:21.239811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2410d1-d149-4988-ad15-cb9aaa886c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:21.241567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2410d1-d149-4988-ad15-cb9aaa886c9b service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:21.274830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 912/1828] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:21.752138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:21.754204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:21.778779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e55b-5894-471a-953a-a4a999775369 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:21.792414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:21.794073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:21.794580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:21.795065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] PATH_INFO: `/v3/users/ddf6093c259841a79615be1c24723e11` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:21.796638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf6093c259841a79615be1c24723e11)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:21.799646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:21.915351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf6093c259841a79615be1c24723e11'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:21.944156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf6093c259841a79615be1c24723e11'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:21.957824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf6093c259841a79615be1c24723e11'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:21.958630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf6093c259841a79615be1c24723e11'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:21.978365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf6093c259841a79615be1c24723e11'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:22.010965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 917/1829] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:21 2022] DELETE /identity/v3/users/ddf6093c259841a79615be1c24723e11 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:22.012480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.012982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.012982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.064840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:22.066142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.175006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 913/1830] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:22.204869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:22.206339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.285074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:22.286518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.307271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780da98-f8a0-48bf-a614-8a1d3081883f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:22.326685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:22.327526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.327983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.328414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] PATH_INFO: `/v3/projects/4f575ce767d447119b8ce346f778ffd4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.331265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f575ce767d447119b8ce346f778ffd4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:22.333463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:22.340868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e5352-314f-427c-9272-ea5f343a5abf admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:22.348832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e310dd8-7faa-414a-8102-53d1d5d96596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:22.349827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e310dd8-7faa-414a-8102-53d1d5d96596 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.350274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e310dd8-7faa-414a-8102-53d1d5d96596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.350704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e310dd8-7faa-414a-8102-53d1d5d96596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.372307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e310dd8-7faa-414a-8102-53d1d5d96596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:22.379602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e310dd8-7faa-414a-8102-53d1d5d96596 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:22.406535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 918/1831] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:22.494371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f575ce767d447119b8ce346f778ffd4', 'request_id': 'req-a185d8ad-c140-4a0e-9c6d-59ccdb041923'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:22.522474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130aec9-f3c0-4160-9bd6-937eb01c4dc9 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.522820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130aec9-f3c0-4160-9bd6-937eb01c4dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.523360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130aec9-f3c0-4160-9bd6-937eb01c4dc9 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.525861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 919/1832] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 18:43:22.529515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f575ce767d447119b8ce346f778ffd4', 'request_id': 'req-a185d8ad-c140-4a0e-9c6d-59ccdb041923'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:22.542475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c173ce-f760-4340-b456-809912f3c6ee None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.542764 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c173ce-f760-4340-b456-809912f3c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.543154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c173ce-f760-4340-b456-809912f3c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.549418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f575ce767d447119b8ce346f778ffd4', 'request_id': 'req-a185d8ad-c140-4a0e-9c6d-59ccdb041923'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:22.583726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b7c173ce-f760-4340-b456-809912f3c6ee None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:22.584695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] The token cache is being invalidate because project 4f575ce767d447119b8ce346f778ffd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:22.585108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:22.587796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b7c173ce-f760-4340-b456-809912f3c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.588326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a185d8ad-c140-4a0e-9c6d-59ccdb041923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:22.592149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 914/1833] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:22 2022] DELETE /identity/v3/projects/4f575ce767d447119b8ce346f778ffd4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:22.597335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.597624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.609929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.668160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:22.672061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.773073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 920/1834] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:22.834208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 915/1835] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:22.842102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.842613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.842924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.867825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:22.869087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.875934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:22.877303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.887721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 921/1836] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:22.888703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:22.896870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128b81b-1e76-44d2-b0a2-fe0f548c104b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:22.906500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:22.907664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.908047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.908423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.909894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2abc09-7860-4713-a1a8-cf39fe9de11e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:22.920665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:22.921312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:22.922318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:22.922611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:22.922889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:22.923528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:22.923663 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:22.923963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:22.925596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:22.950822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 916/1837] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:22.952179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:22.957474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:22.962725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 922/1838] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:22.966560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:22.985340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f505-354f-437a-85ec-e80b37155e76 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:22.994031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53246fd3-5551-4860-b2f1-e297c5e14140 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.000330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.001114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.002311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.002668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.003239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.004505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.004897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.005085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.005312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] PATH_INFO: `/v3/users/c90a491bf41244cb8d72af806651a0a6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.008476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90a491bf41244cb8d72af806651a0a6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.011178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.011439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.067405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 923/1839] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:22 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:23.071387 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:23.107532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90a491bf41244cb8d72af806651a0a6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:23.126012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90a491bf41244cb8d72af806651a0a6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:23.143458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90a491bf41244cb8d72af806651a0a6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:23.144412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90a491bf41244cb8d72af806651a0a6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:23.145439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d6fdcde3-30e0-4ac2-b5c6-1b9d0448ed47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90a491bf41244cb8d72af806651a0a6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:23.167215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 917/1840] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:22 2022] DELETE /identity/v3/users/c90a491bf41244cb8d72af806651a0a6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:23.176495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.177810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.179195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.199845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1b299-7648-40e3-bd01-f8a507005e1b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.229698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:23.231507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:23.321995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.323283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.323789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.324278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.325794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.329362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.360132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 918/1841] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:23.382386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 924/1842] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:23 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:23.382712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:23.384183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:23.397245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a63fe-89f7-4bc0-895a-40f0548cf597 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.404477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.405432 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.405761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.406179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.407128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.408958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.421789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 919/1843] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:23.426454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:23.430059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:23.433527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:23.451913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921c5d-3ea3-4352-816d-e19cd1382cf2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.464388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.466455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.467423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.467987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.471671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.473792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.491427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 925/1844] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:23.493292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:23.505761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb503-c794-49dc-b32f-10ba6a4ef74f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.511581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92152e0f-88b9-44da-96d0-3d513721dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.513064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152e0f-88b9-44da-96d0-3d513721dbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.513568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152e0f-88b9-44da-96d0-3d513721dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.514091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152e0f-88b9-44da-96d0-3d513721dbf6 admin admin] PATH_INFO: `/v3/projects/76f8f0262351489b9fff2553077ed957/users/c7d8607b008940a4bd5f2eea1443bb7a/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.536086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152e0f-88b9-44da-96d0-3d513721dbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f8f0262351489b9fff2553077ed957, user_id=c7d8607b008940a4bd5f2eea1443bb7a, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.540745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152e0f-88b9-44da-96d0-3d513721dbf6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.563558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 926/1845] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:23 2022] PUT /identity/v3/projects/76f8f0262351489b9fff2553077ed957/users/c7d8607b008940a4bd5f2eea1443bb7a/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:23.576396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.576924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.578071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.592557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ea107-18ae-42fb-9da0-0cd8fcf991a1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.616375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] MFA Rules not processed for user `c7d8607b008940a4bd5f2eea1443bb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:23.617783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:23.741735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 927/1846] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:23.748552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:23.751896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:23.754335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.755018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.755335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.755622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.835214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5717d0-200d-41fb-9aec-0443201ee3b7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:23.841388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:23.842157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:23.842349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:23.842633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:23.854695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.856224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.868251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:23.868996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 928/1847] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:23.870369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:23.883036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 920/1848] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:24.069574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:24.072507 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:24.100954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b176b-e493-4157-bf18-cff77c13fcf1 service glance] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:24.106553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:24.107993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:24.108328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:24.108615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] PATH_INFO: `/v3/projects/0380ad73d39c4870bac9365e5dc33b1d` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:24.109909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0380ad73d39c4870bac9365e5dc33b1d)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:24.112026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:24.194166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0380ad73d39c4870bac9365e5dc33b1d', 'request_id': 'req-e5519b17-a01b-4795-a973-22fbf2f2d8da'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.215130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0380ad73d39c4870bac9365e5dc33b1d', 'request_id': 'req-e5519b17-a01b-4795-a973-22fbf2f2d8da'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.223684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0380ad73d39c4870bac9365e5dc33b1d', 'request_id': 'req-e5519b17-a01b-4795-a973-22fbf2f2d8da'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.239442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] The token cache is being invalidate because project 0380ad73d39c4870bac9365e5dc33b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:24.239773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.240594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.242776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 929/1849] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:24 2022] DELETE /identity/v3/projects/0380ad73d39c4870bac9365e5dc33b1d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:24.247013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:24.264358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01e9c-a2f4-4fbb-9b7d-ec64b997804f service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:24.365372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:24.366270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:24.366554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:24.366829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] PATH_INFO: `/v3/users/6c43191325f34707b249b03dd28f0352` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:24.368080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c43191325f34707b249b03dd28f0352)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:24.370197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:24.478515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c43191325f34707b249b03dd28f0352'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.508760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c43191325f34707b249b03dd28f0352'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.530297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c43191325f34707b249b03dd28f0352'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.531565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c43191325f34707b249b03dd28f0352'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.532800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c43191325f34707b249b03dd28f0352'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:24.574140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 921/1850] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:24 2022] DELETE /identity/v3/users/6c43191325f34707b249b03dd28f0352 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:24.970552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:24.973356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:24.989183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:24.990228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:24.996104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519b17-a01b-4795-a973-22fbf2f2d8da admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:25.135662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:25.136822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.137639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.137924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] PATH_INFO: `/v3/projects/4cf1fe715e3d49599cf1b1dcbc313de8` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.141887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf1fe715e3d49599cf1b1dcbc313de8)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:25.145613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:25.178788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf486df-aaad-4c6c-af74-518781846737 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:25.192813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:25.193702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.194596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.194884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] PATH_INFO: `/v3/projects/b26b00a1efd5403dae4f9f0d4c07961e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.201271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26b00a1efd5403dae4f9f0d4c07961e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:25.203265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:25.242921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf1fe715e3d49599cf1b1dcbc313de8', 'request_id': 'req-334d2fb1-dd79-435e-b4ed-089c91870230'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.259984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf1fe715e3d49599cf1b1dcbc313de8', 'request_id': 'req-334d2fb1-dd79-435e-b4ed-089c91870230'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.268671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf1fe715e3d49599cf1b1dcbc313de8', 'request_id': 'req-334d2fb1-dd79-435e-b4ed-089c91870230'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.306608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] The token cache is being invalidate because project 4cf1fe715e3d49599cf1b1dcbc313de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:25.306906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.320075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-334d2fb1-dd79-435e-b4ed-089c91870230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.347603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 930/1851] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:24 2022] DELETE /identity/v3/projects/4cf1fe715e3d49599cf1b1dcbc313de8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:25.347603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbe5f-1539-4388-a5d5-eff428b1c73b None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.347603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbe5f-1539-4388-a5d5-eff428b1c73b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.347603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbe5f-1539-4388-a5d5-eff428b1c73b None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.367893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26b00a1efd5403dae4f9f0d4c07961e', 'request_id': 'req-a4dcc942-e7a4-473f-b385-7b4fabc92a58'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.368780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 931/1852] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:43:25 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:43:25.369894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbbe5f-1539-4388-a5d5-eff428b1c73b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:25.375322 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c0cbbe5f-1539-4388-a5d5-eff428b1c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:25.385116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26b00a1efd5403dae4f9f0d4c07961e', 'request_id': 'req-a4dcc942-e7a4-473f-b385-7b4fabc92a58'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.397961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26b00a1efd5403dae4f9f0d4c07961e', 'request_id': 'req-a4dcc942-e7a4-473f-b385-7b4fabc92a58'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.422465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] The token cache is being invalidate because project b26b00a1efd5403dae4f9f0d4c07961e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:25.423207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.426827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-a4dcc942-e7a4-473f-b385-7b4fabc92a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.429391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 922/1853] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:24 2022] DELETE /identity/v3/projects/b26b00a1efd5403dae4f9f0d4c07961e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:25.432243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89161-3e30-47b1-aa83-5a81290810e4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.432794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89161-3e30-47b1-aa83-5a81290810e4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.434877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89161-3e30-47b1-aa83-5a81290810e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.484734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c7f89161-3e30-47b1-aa83-5a81290810e4 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:25.485963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c7f89161-3e30-47b1-aa83-5a81290810e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:25.570823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbbe5f-1539-4388-a5d5-eff428b1c73b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:25.582800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:25.583857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.584162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.584460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] PATH_INFO: `/v3/users/139d90a9a3e043ad9dbb79000b6c4c82` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.586896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139d90a9a3e043ad9dbb79000b6c4c82)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:25.589228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:25.666104 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 923/1854] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:25.667644 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e571f-9fb1-4f56-835e-90402e8a5d10 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.667942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e571f-9fb1-4f56-835e-90402e8a5d10 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.668258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e571f-9fb1-4f56-835e-90402e8a5d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.697866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139d90a9a3e043ad9dbb79000b6c4c82'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.701305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b45e571f-9fb1-4f56-835e-90402e8a5d10 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:25.706966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b45e571f-9fb1-4f56-835e-90402e8a5d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:25.716936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139d90a9a3e043ad9dbb79000b6c4c82'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.727453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139d90a9a3e043ad9dbb79000b6c4c82'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.728237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139d90a9a3e043ad9dbb79000b6c4c82'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.733719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 924/1855] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:25.740673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139d90a9a3e043ad9dbb79000b6c4c82'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:25.743969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.744450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.744874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.752284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 932/1856] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:25 2022] DELETE /identity/v3/users/139d90a9a3e043ad9dbb79000b6c4c82 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:25.783075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:25.784585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:25.870790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 925/1857] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:25.874833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:25.892435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ce2c2-0e8c-4ebd-8754-a9ec33252845 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:25.899925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:25.901118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.901977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.903714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.904778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:25.905352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:25.907489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:25.950244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 933/1858] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:25.954580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:25.965912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde889-1037-4ba0-9d48-0efba1be641e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:25.971564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:25.972529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:25.972883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:25.975153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:25.975153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:25.979398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.017386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.020612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 926/1859] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:25 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:26.021425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.033491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.149047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeade88-a9ae-453b-a58d-31db2d61590e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.154806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70f3a6-5813-4077-b770-6246f66ec818 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.161183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.161941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.162824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.173965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.175956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.177946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.221088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 927/1860] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:26 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:26.226773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.242150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04f3c-8ce7-4dcd-a0ba-1c2226be2ca9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.249543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.250588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.251302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.251302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.252052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.254342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.256674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.257821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.258651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.259190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.261502 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.271709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 928/1861] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:26.274488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.287963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c60805-aabd-42fb-aefa-ff1bcd5908e4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.291769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.293556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.295083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c291c-7be6-4c55-976e-014414c4eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.295795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c291c-7be6-4c55-976e-014414c4eca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.296333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c291c-7be6-4c55-976e-014414c4eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.296628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c291c-7be6-4c55-976e-014414c4eca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.297373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c291c-7be6-4c55-976e-014414c4eca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.299785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c291c-7be6-4c55-976e-014414c4eca4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.314214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 934/1862] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:26.329777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 929/1863] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:26.333809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.366644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4bdb-f3b5-45dc-b772-91bfdba71d6b service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.384167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.385105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.385391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.385744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] PATH_INFO: `/v3/projects/72cf05d04e9e4672865225637be06b5c/users/a977f1c2a7784c8da066922cc6b52cfd/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.408572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cf05d04e9e4672865225637be06b5c, user_id=a977f1c2a7784c8da066922cc6b52cfd, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.411366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.455796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 935/1864] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:26 2022] PUT /identity/v3/projects/72cf05d04e9e4672865225637be06b5c/users/a977f1c2a7784c8da066922cc6b52cfd/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:26.456005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.456455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.457064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.525831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.528292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.533193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] MFA Rules not processed for user `a977f1c2a7784c8da066922cc6b52cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:26.534503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.629351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6d3c-a7ef-48e7-8f9b-7a71c9a639d4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.635695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.636684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.636922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.637222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] PATH_INFO: `/v3/projects/b223d11115044ffe949b2ccab1326584` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.638450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b223d11115044ffe949b2ccab1326584)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.640468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.660912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 930/1865] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:26.700878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.702369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.706855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b223d11115044ffe949b2ccab1326584', 'request_id': 'req-ef899275-353d-4971-8aa8-5c7b66102e17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:26.717815 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b223d11115044ffe949b2ccab1326584', 'request_id': 'req-ef899275-353d-4971-8aa8-5c7b66102e17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:26.724994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b223d11115044ffe949b2ccab1326584', 'request_id': 'req-ef899275-353d-4971-8aa8-5c7b66102e17'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:26.742728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] The token cache is being invalidate because project b223d11115044ffe949b2ccab1326584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:26.743235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:26.747902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef899275-353d-4971-8aa8-5c7b66102e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:26.750801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 936/1866] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:26 2022] DELETE /identity/v3/projects/b223d11115044ffe949b2ccab1326584 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:26.758208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5d2a6-9803-45a0-a8bc-7457f4a410cd None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.758797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5d2a6-9803-45a0-a8bc-7457f4a410cd None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.759223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5d2a6-9803-45a0-a8bc-7457f4a410cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.796546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-08c5d2a6-9803-45a0-a8bc-7457f4a410cd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:26.797800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-08c5d2a6-9803-45a0-a8bc-7457f4a410cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.802506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20659c4e-21c3-4fa3-a786-114f8b28fbd7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.899274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.900530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.900824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.901199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.910203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 937/1867] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:26.910367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.915017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.915500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.915786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.936319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:26.937726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:26.946881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 938/1868] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:26.951098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.959947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c5e9-4eb8-482c-8e22-2faab6d1dda9 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:26.964442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.964770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:26.965516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:26.965793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:26.966012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.966130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:26.966802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:26.967206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:26.968812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:26.976103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 931/1869] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:26.982249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 939/1870] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:26.986576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.990309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:26.991964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:27.002320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a07205-be8a-4c2b-a7cc-43e9758679de service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.008493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.009220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.009595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.009956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.010323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeba15-01fe-4bd2-80a7-5a4081396847 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.010769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.013171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.017314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.018364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.019689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.020113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] PATH_INFO: `/v3/users/a977f1c2a7784c8da066922cc6b52cfd` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.022647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a977f1c2a7784c8da066922cc6b52cfd)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.029476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.058826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 932/1871] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:26 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:27.064816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.137584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a977f1c2a7784c8da066922cc6b52cfd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:27.157329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a977f1c2a7784c8da066922cc6b52cfd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:27.166791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a977f1c2a7784c8da066922cc6b52cfd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:27.167744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a977f1c2a7784c8da066922cc6b52cfd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:27.178425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cf2fe863-d099-4690-adb2-2e6548500fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a977f1c2a7784c8da066922cc6b52cfd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:27.179556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bcdf6-63ef-4542-8513-fdb4e200e0de admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.184654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.185212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 940/1872] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:26 2022] DELETE /identity/v3/users/a977f1c2a7784c8da066922cc6b52cfd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:27.187619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.189376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.189590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.189886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.191450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.192041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.192863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.194836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.208626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:27.209837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:27.221495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 933/1873] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:27 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:27.222565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.224308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:27.237085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1ed81-f452-465b-9dca-f83fbe5f060e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.270843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 941/1874] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:27.282307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.284485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:27.302156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.302859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.303584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.303584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.304379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.306001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.316248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 934/1875] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:27.320304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.330502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e22857-4e02-4322-a14d-0cab93228f66 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.338926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.339834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.340867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.341215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.342122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.344102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.351410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b7db-d673-463a-a84c-f4cc5620353d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.356361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c40f7-c859-41f7-9149-867066e77112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.356946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 935/1876] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:27.359265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c40f7-c859-41f7-9149-867066e77112 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.359776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c40f7-c859-41f7-9149-867066e77112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.360258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c40f7-c859-41f7-9149-867066e77112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.361769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.373960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a079b7e-80f4-4e09-b334-332a971ec15e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.379788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c40f7-c859-41f7-9149-867066e77112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.380888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.381255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c40f7-c859-41f7-9149-867066e77112 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.382326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.382789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.383298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] PATH_INFO: `/v3/projects/4160adf117ea4c83ab32fca76570f767/users/9f3e23b555334a36bf350decfd19b315/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.392388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 942/1877] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:27.404869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4160adf117ea4c83ab32fca76570f767, user_id=9f3e23b555334a36bf350decfd19b315, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.408717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.425073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 936/1878] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:27 2022] PUT /identity/v3/projects/4160adf117ea4c83ab32fca76570f767/users/9f3e23b555334a36bf350decfd19b315/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:27.437429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.437805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.438146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.481169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] MFA Rules not processed for user `9f3e23b555334a36bf350decfd19b315`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:27.482448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:27.566211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 943/1879] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:27.570705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.665779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659665a6-c328-4b23-9c76-c0140c8ae67b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.672615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.673081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.673431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.673902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.674774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.677492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.717435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 937/1880] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:27 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:27.722231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.738221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e2e02-5c16-415e-8834-5b3bf7c6a624 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.808572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.809780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.810062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.810335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.811148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.813097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.843545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 944/1881] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:27 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:27.845477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.861321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cda14-3631-4a9b-8e07-fc606e03bcaf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.866750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.867816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.868243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.868660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.873734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.876005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:27.891239 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 938/1882] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:27.896391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:27.921481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35854ef-0c39-4d34-a2e5-ca8ae355d021 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:27.929174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:27.931136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:27.931136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:27.932241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] PATH_INFO: `/v3/projects/859ae05dcc1b4b12bbb49f4bfd27fd0a/users/aacc009157104082b546e8ad4b2bcede/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:27.964631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859ae05dcc1b4b12bbb49f4bfd27fd0a, user_id=aacc009157104082b546e8ad4b2bcede, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:27.968378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.000796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 945/1883] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:27 2022] PUT /identity/v3/projects/859ae05dcc1b4b12bbb49f4bfd27fd0a/users/aacc009157104082b546e8ad4b2bcede/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:28.004735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.044901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181860-10ba-47be-88a6-96e7424f3fba admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.106812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.109567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:28.172689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.173382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.173666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.176040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.176040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.176608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.222118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 939/1884] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:28.223036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.236242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ffac7-701f-4072-8551-e234567d0766 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.253683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90198c04-2f67-4d91-b73f-071164f2096c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.260640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.263180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4a3ee-9edf-49a4-90b9-6661e3839b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.264077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.264189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4a3ee-9edf-49a4-90b9-6661e3839b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.264365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4a3ee-9edf-49a4-90b9-6661e3839b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.264697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4a3ee-9edf-49a4-90b9-6661e3839b4f admin admin] PATH_INFO: `/v3/projects/859ae05dcc1b4b12bbb49f4bfd27fd0a/users/aacc009157104082b546e8ad4b2bcede/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.267298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.270136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] PATH_INFO: `/v3/projects/72cf05d04e9e4672865225637be06b5c` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.273637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cf05d04e9e4672865225637be06b5c)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.276119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4a3ee-9edf-49a4-90b9-6661e3839b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=859ae05dcc1b4b12bbb49f4bfd27fd0a, user_id=aacc009157104082b546e8ad4b2bcede, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.282083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.287240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4a3ee-9edf-49a4-90b9-6661e3839b4f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.319316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 940/1885] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:28 2022] PUT /identity/v3/projects/859ae05dcc1b4b12bbb49f4bfd27fd0a/users/aacc009157104082b546e8ad4b2bcede/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:28.331009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.331633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.332014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.374577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] MFA Rules not processed for user `aacc009157104082b546e8ad4b2bcede`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:28.376124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:28.389497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cf05d04e9e4672865225637be06b5c', 'request_id': 'req-4b176016-d267-43ea-b59f-2784ee5dff41'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:28.422081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cf05d04e9e4672865225637be06b5c', 'request_id': 'req-4b176016-d267-43ea-b59f-2784ee5dff41'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:28.448442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cf05d04e9e4672865225637be06b5c', 'request_id': 'req-4b176016-d267-43ea-b59f-2784ee5dff41'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:28.484097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] The token cache is being invalidate because project 72cf05d04e9e4672865225637be06b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:28.484619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:28.485976 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4b176016-d267-43ea-b59f-2784ee5dff41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:28.488829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 946/1886] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:28 2022] DELETE /identity/v3/projects/72cf05d04e9e4672865225637be06b5c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:28.493826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc0a7-17f9-42c7-8815-3f2240eb039d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.494114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc0a7-17f9-42c7-8815-3f2240eb039d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.494391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc0a7-17f9-42c7-8815-3f2240eb039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.495322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 941/1887] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:28.510167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.512452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:28.531146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-18dfc0a7-17f9-42c7-8815-3f2240eb039d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:28.533356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-18dfc0a7-17f9-42c7-8815-3f2240eb039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:28.580733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3d239-d50f-44e2-b1ab-9acbbde37d8c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.584584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.585244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.585533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.585816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.587755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:28.600064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.601507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.604600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 947/1888] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:28.611345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 942/1889] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:28.612385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.612676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.612956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.631153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:28.632389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:28.641932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 948/1890] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:28.646548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.657593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d172ab-21e2-446c-a081-4b1c4faa7ca5 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.662662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.663500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.663854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.664145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.664872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:28.665219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.666930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.679360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 943/1891] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:28.684535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.695019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5295a-7c16-4c8b-9d48-609757ec6e39 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.700997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.701643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.702001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.702283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.702977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.705812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.740307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 949/1892] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:28 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:28.744521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.765613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dac893-83b8-40cd-ac69-bae21040cf69 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.827793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.828515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.828803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.829107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.829794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.832011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.855868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 944/1893] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:28 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:28.859526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.879772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4004b2c-a34c-4f72-a44a-56f98678517d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.886368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.887830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.888189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.888536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.889516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.891648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.907209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 950/1894] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:28.910818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.922589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724554-f442-4578-a121-11ff67a1b8a1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.932405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.932405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.932405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.932405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.932819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.934630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.945506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 945/1895] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:28.950327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:28.962602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6ed7-d05d-4a3c-881a-52333f3b2b2c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:28.968896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0f5a-c598-4138-a256-4acfe6be4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:28.969888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0f5a-c598-4138-a256-4acfe6be4e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:28.970235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0f5a-c598-4138-a256-4acfe6be4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:28.970587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0f5a-c598-4138-a256-4acfe6be4e0f admin admin] PATH_INFO: `/v3/projects/54ab62bb70a3448595a56b1c8fde0ad9/users/00a74c220bce400eaa5bd0abd4d34d41/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:28.985926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0f5a-c598-4138-a256-4acfe6be4e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab62bb70a3448595a56b1c8fde0ad9, user_id=00a74c220bce400eaa5bd0abd4d34d41, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:28.988762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0f5a-c598-4138-a256-4acfe6be4e0f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:28.993984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.006717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 951/1896] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:28 2022] PUT /identity/v3/projects/54ab62bb70a3448595a56b1c8fde0ad9/users/00a74c220bce400eaa5bd0abd4d34d41/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:29.017256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.017746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.018027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.051860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] MFA Rules not processed for user `00a74c220bce400eaa5bd0abd4d34d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:29.053318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:29.090282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a2cd5-7aad-4729-b636-9b89e3fc5510 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.139939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 952/1897] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:29.145414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.177189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aacc009157104082b546e8ad4b2bcede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.177867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.178152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.178431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.179353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:29.179663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.181262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.197493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 946/1898] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:29.203482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.214901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c539ae-b8c2-4261-b21e-10a1c7ecd343 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.219359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aacc009157104082b546e8ad4b2bcede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.219491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799b0c-511c-4ecd-855b-cc5821ec84a0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.220065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.220306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.220584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.221277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.223220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.224120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.224805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.225063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.225344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.226065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.228310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.255703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 947/1899] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:29 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:29.258589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 953/1900] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:29 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:29.259838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.262632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.324149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f902f3c-801e-42c5-a7f0-fc74f178daca tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.327752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e880a-e809-49b8-afae-11e1405511a9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.333156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.333618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.333907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.334186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.334953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.337099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.363298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 954/1901] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:29 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:29.364750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.374776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6891-ff8a-49bf-8192-f95ed2ab054c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.380258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.380943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.381233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.381516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.382253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.383910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.389138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aacc009157104082b546e8ad4b2bcede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.389833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.390125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.390424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.391435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:29.391751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.393376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.395049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 955/1902] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:29.399693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.410124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaefd-6c22-445f-967a-55eaec72ab8c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.410533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 948/1903] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:29.422166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.423861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.424232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.424633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] PATH_INFO: `/v3/projects/4d6dbf71d23c4c468737abf91665af0a/users/f34914b248614d998ed58df94c4c870c/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.448255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6dbf71d23c4c468737abf91665af0a, user_id=f34914b248614d998ed58df94c4c870c, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.451343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.455888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.468442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3283-4754-4f4a-8f98-5aa9d3323875 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.476815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aacc009157104082b546e8ad4b2bcede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.478265 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.478813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.479099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] PATH_INFO: `/v3/projects/822f8fd9449c4ecbb21a4bfa8e1824d7` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.480458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorizing `identity:delete_project(project_id=822f8fd9449c4ecbb21a4bfa8e1824d7)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.483075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.490029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 956/1904] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:29 2022] PUT /identity/v3/projects/4d6dbf71d23c4c468737abf91665af0a/users/f34914b248614d998ed58df94c4c870c/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:29.494079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.538262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822f8fd9449c4ecbb21a4bfa8e1824d7', 'request_id': 'req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:29.549490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822f8fd9449c4ecbb21a4bfa8e1824d7', 'request_id': 'req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:29.557215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822f8fd9449c4ecbb21a4bfa8e1824d7', 'request_id': 'req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:29.571708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] The token cache is being invalidate because project 822f8fd9449c4ecbb21a4bfa8e1824d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:29.571941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc81a-881a-4daa-9da9-fb754bd3ce29 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.572183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:29.573162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:29.575359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 949/1905] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:29 2022] DELETE /identity/v3/projects/822f8fd9449c4ecbb21a4bfa8e1824d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:29.662164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35389cb3-2521-4306-86d1-09459e085c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.662164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389cb3-2521-4306-86d1-09459e085c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.662164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389cb3-2521-4306-86d1-09459e085c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.662164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389cb3-2521-4306-86d1-09459e085c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.662788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35389cb3-2521-4306-86d1-09459e085c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.662788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35389cb3-2521-4306-86d1-09459e085c89 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.671216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 957/1906] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:29.672851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.674733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:29.689553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e5ff5-46ad-444d-a183-7b2e888d2ae8 tempest-VolumeQuotaClassesTest-389176492 tempest-VolumeQuotaClassesTest-389176492-project-admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.694444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.695582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.695874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.696154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] PATH_INFO: `/v3/projects/4d6dbf71d23c4c468737abf91665af0a/users/f34914b248614d998ed58df94c4c870c/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.698499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6dbf71d23c4c468737abf91665af0a, user_id=f34914b248614d998ed58df94c4c870c, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.701761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.715968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 950/1907] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:29 2022] PUT /identity/v3/projects/4d6dbf71d23c4c468737abf91665af0a/users/f34914b248614d998ed58df94c4c870c/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:29.729058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.729207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.729509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.773946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] MFA Rules not processed for user `f34914b248614d998ed58df94c4c870c`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:29.775281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:29.818952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.821407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:29.861123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 958/1908] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:29.874025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:29.875762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:29.899483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1427eeb-ff2f-41c4-8dcc-de76c24ce121 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.905270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.906377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.906711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.907081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] PATH_INFO: `/v3/users/9f3e23b555334a36bf350decfd19b315` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.909960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3e23b555334a36bf350decfd19b315)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:29.912096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:29.950509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd927-20c0-4422-b31b-59d5d9b86810 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:29.955470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:29.956235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:29.956938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:29.956938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:29.958768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:29.975598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3e23b555334a36bf350decfd19b315'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:29.989914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3e23b555334a36bf350decfd19b315'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.008854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3e23b555334a36bf350decfd19b315'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.009770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3e23b555334a36bf350decfd19b315'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.010561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3e23b555334a36bf350decfd19b315'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.025991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 951/1909] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:29 2022] DELETE /identity/v3/users/9f3e23b555334a36bf350decfd19b315 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:30.026812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:30.028754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:30.037101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:30.038808 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704db01d-3eff-4b5b-9f95-debc09e45efa service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:30.048678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 959/1910] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:30.049935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d114b-1998-4480-aef1-672d0648476e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:30.050230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d114b-1998-4480-aef1-672d0648476e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:30.050564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d114b-1998-4480-aef1-672d0648476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:30.068907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c45d114b-1998-4480-aef1-672d0648476e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:30.070521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c45d114b-1998-4480-aef1-672d0648476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:30.116743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d290-aba2-4358-8b9a-e7e2a82f1c20 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:30.122147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:30.123042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:30.123389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:30.123651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] PATH_INFO: `/v3/users/ce510c50c0424237b81660d1d46a24d4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:30.125325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce510c50c0424237b81660d1d46a24d4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:30.126849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:30.138257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 960/1911] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:30.147874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d114b-1998-4480-aef1-672d0648476e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:30.149410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c45d114b-1998-4480-aef1-672d0648476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:30.200768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce510c50c0424237b81660d1d46a24d4'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.214735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce510c50c0424237b81660d1d46a24d4'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.234871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce510c50c0424237b81660d1d46a24d4'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.238916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce510c50c0424237b81660d1d46a24d4'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.241321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d114b-1998-4480-aef1-672d0648476e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:30.241510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-0d0a344d-ffd9-4735-ac4f-a4f889a1e8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce510c50c0424237b81660d1d46a24d4'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:30.252735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:30.253506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:30.253788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:30.254135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:30.263568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:30.275031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 952/1912] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:30 2022] DELETE /identity/v3/users/ce510c50c0424237b81660d1d46a24d4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:30.277465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:30.278087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:30.278369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:30.295038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:30.297121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:30.303413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:30.305017 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:30.315929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 961/1913] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:30.402514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 953/1914] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:30.417089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:30.419160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:30.434917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae0451-42df-431d-af85-59b25fb64f24 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:30.534057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:30.534981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:30.535395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:30.535782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:30.548664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:30.550582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:30.569444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 962/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:31.054016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:31.055499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:31.068830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0061ce8-abfe-4a3e-85aa-d4193965b048 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:31.073747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:31.074761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:31.075232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:31.075599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] PATH_INFO: `/v3/projects/4160adf117ea4c83ab32fca76570f767` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:31.076895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4160adf117ea4c83ab32fca76570f767)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:31.079071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:31.109494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:31.111244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:31.132820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa6ab-fe0a-4e6f-9612-efd2c54cd1c5 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:31.140738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:31.142002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:31.142446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:31.142882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] PATH_INFO: `/v3/projects/8a55068fcff34a5d9d2802659a986d21` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:31.144749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a55068fcff34a5d9d2802659a986d21)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:31.147378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:31.158744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4160adf117ea4c83ab32fca76570f767', 'request_id': 'req-f81a4c4f-5535-4feb-9558-cafe4772f007'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.171369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4160adf117ea4c83ab32fca76570f767', 'request_id': 'req-f81a4c4f-5535-4feb-9558-cafe4772f007'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.177364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4160adf117ea4c83ab32fca76570f767', 'request_id': 'req-f81a4c4f-5535-4feb-9558-cafe4772f007'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.191404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] The token cache is being invalidate because project 4160adf117ea4c83ab32fca76570f767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:31.191878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.192769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.194992 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 954/1916] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:31 2022] DELETE /identity/v3/projects/4160adf117ea4c83ab32fca76570f767 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:31.200666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:31.204650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:31.216241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a55068fcff34a5d9d2802659a986d21', 'request_id': 'req-467a5555-cc30-4764-ac44-d13861d4676b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.228790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a55068fcff34a5d9d2802659a986d21', 'request_id': 'req-467a5555-cc30-4764-ac44-d13861d4676b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.235271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a55068fcff34a5d9d2802659a986d21', 'request_id': 'req-467a5555-cc30-4764-ac44-d13861d4676b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.247759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] The token cache is being invalidate because project 8a55068fcff34a5d9d2802659a986d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:31.248320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.249007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.250563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 963/1917] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:31 2022] DELETE /identity/v3/projects/8a55068fcff34a5d9d2802659a986d21 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:31.254342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:31.255731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:31.279740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a4c4f-5535-4feb-9558-cafe4772f007 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:31.326304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a5555-cc30-4764-ac44-d13861d4676b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:31.330902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:31.331798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:31.332082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:31.332356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] PATH_INFO: `/v3/users/05cccb04316044299a9a2f4d3bcea922` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:31.333547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05cccb04316044299a9a2f4d3bcea922)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:31.335594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:31.338691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:31.339895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:31.340337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:31.342346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] PATH_INFO: `/v3/users/aacc009157104082b546e8ad4b2bcede` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:31.343919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacc009157104082b546e8ad4b2bcede)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:31.346070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:31.393162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05cccb04316044299a9a2f4d3bcea922'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.395947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacc009157104082b546e8ad4b2bcede'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.405992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05cccb04316044299a9a2f4d3bcea922'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.407493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacc009157104082b546e8ad4b2bcede'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.413870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05cccb04316044299a9a2f4d3bcea922'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.414664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05cccb04316044299a9a2f4d3bcea922'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.416778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacc009157104082b546e8ad4b2bcede'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.417564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacc009157104082b546e8ad4b2bcede'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.418870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-990745a9-0b93-4781-8567-7ac33ca5d7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacc009157104082b546e8ad4b2bcede'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.422748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05cccb04316044299a9a2f4d3bcea922'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:31.428795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 964/1918] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:31 2022] DELETE /identity/v3/users/05cccb04316044299a9a2f4d3bcea922 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:31.431406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 955/1919] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:31 2022] DELETE /identity/v3/users/aacc009157104082b546e8ad4b2bcede => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:31.957332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:31.958914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.045964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326e81-9e0c-46d1-b071-a6ce1bae4e9c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.113283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.114173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.114461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.114743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] PATH_INFO: `/v3/projects/859ae05dcc1b4b12bbb49f4bfd27fd0a` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.116030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859ae05dcc1b4b12bbb49f4bfd27fd0a)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.118019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.190073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'request_id': 'req-b3a73f25-a105-46b9-a63c-1ca9debf5444'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.201478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'request_id': 'req-b3a73f25-a105-46b9-a63c-1ca9debf5444'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.213428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859ae05dcc1b4b12bbb49f4bfd27fd0a', 'request_id': 'req-b3a73f25-a105-46b9-a63c-1ca9debf5444'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.226549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] The token cache is being invalidate because project 859ae05dcc1b4b12bbb49f4bfd27fd0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:32.227131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.227710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.229889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 965/1920] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:31 2022] DELETE /identity/v3/projects/859ae05dcc1b4b12bbb49f4bfd27fd0a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:32.235260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9ddd-7444-41c7-8bd1-0901025a5b69 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.235773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9ddd-7444-41c7-8bd1-0901025a5b69 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.235864 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9ddd-7444-41c7-8bd1-0901025a5b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.256405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b41d9ddd-7444-41c7-8bd1-0901025a5b69 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:32.257849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b41d9ddd-7444-41c7-8bd1-0901025a5b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.300335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.302227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.387948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 956/1921] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:32.399791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a73f25-a105-46b9-a63c-1ca9debf5444 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.399959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.400305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.400727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.414073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.414813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.415405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.415830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] PATH_INFO: `/v3/projects/f40608bac0bd458293942f7477d11d62` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.417424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40608bac0bd458293942f7477d11d62)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.419605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.461316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:32.477692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.509259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40608bac0bd458293942f7477d11d62', 'request_id': 'req-189d95c3-f68d-49d7-a757-160073867c00'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.517428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 957/1922] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:32.524666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.532576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40608bac0bd458293942f7477d11d62', 'request_id': 'req-189d95c3-f68d-49d7-a757-160073867c00'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.545130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40608bac0bd458293942f7477d11d62', 'request_id': 'req-189d95c3-f68d-49d7-a757-160073867c00'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.548617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ebde2-be8f-4a67-8178-8f172293582a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.568749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] The token cache is being invalidate because project f40608bac0bd458293942f7477d11d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:32.569137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.570429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-189d95c3-f68d-49d7-a757-160073867c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.575232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 966/1923] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:32 2022] DELETE /identity/v3/projects/f40608bac0bd458293942f7477d11d62 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:32.580432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec78c3c-d102-4ae1-8275-32d3ffea7f1d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.580954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec78c3c-d102-4ae1-8275-32d3ffea7f1d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.581496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec78c3c-d102-4ae1-8275-32d3ffea7f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.612992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-eec78c3c-d102-4ae1-8275-32d3ffea7f1d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:32.614303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-eec78c3c-d102-4ae1-8275-32d3ffea7f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.634911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.635637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.636076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.636183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.637564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:32.637878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.639673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.660343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 958/1924] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:32.664621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.666454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.676501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 967/1925] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:32.680251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f99d6-d2c9-4744-bdd5-f5f32aaee854 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.684933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.685317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.685688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.686071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.686730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.687013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.687741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.688147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.690150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.705342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:32.706654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.715419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 968/1926] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:32.719670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.724722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 959/1927] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:32.725659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.728656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa443ab-bf10-4506-80df-844f6ac51f34 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.788150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.788826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.789114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.789393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.789484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28d4f-bcc9-46b5-bad0-54d50b4f060b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.790119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:32.790431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.792123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.794541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.795246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.795532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.795812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.796507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.798412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.809629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 969/1928] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:32.810888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.821396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6c67-5b74-4da5-afc9-c3939beecd9a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.821531 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 960/1929] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:32.825078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.826278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.826636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.826942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.827264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.827547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.828268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.830215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.838632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd976b-8dbe-4b27-9c1c-c5b198949f1f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.843324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.844196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.844478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.844749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] PATH_INFO: `/v3/users/00a74c220bce400eaa5bd0abd4d34d41` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.845946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a74c220bce400eaa5bd0abd4d34d41)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.847926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.859627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 970/1930] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:32.860634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.902012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a74c220bce400eaa5bd0abd4d34d41'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.913995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a74c220bce400eaa5bd0abd4d34d41'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.923758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a74c220bce400eaa5bd0abd4d34d41'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.924797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a74c220bce400eaa5bd0abd4d34d41'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.925757 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a74c220bce400eaa5bd0abd4d34d41'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:32.935695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102ee8e-17cf-41fa-884f-4c564734ccd3 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:32.939692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456bed-d456-45d1-815f-2ae51bbaa7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:32.940449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456bed-d456-45d1-815f-2ae51bbaa7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.940800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456bed-d456-45d1-815f-2ae51bbaa7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.941148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456bed-d456-45d1-815f-2ae51bbaa7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.941997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e456bed-d456-45d1-815f-2ae51bbaa7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:32.943780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e456bed-d456-45d1-815f-2ae51bbaa7c9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:32.947173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 961/1931] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:32 2022] DELETE /identity/v3/users/00a74c220bce400eaa5bd0abd4d34d41 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:32.947951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:32.951162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:32.957915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 971/1932] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:32.959840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:32.959840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:32.960127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:32.979599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:32.981656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.044640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29295-1129-4f17-b1d7-b81735c20b99 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.050426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.051155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.051441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.051719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.052423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.054724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.057549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 972/1933] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:33.061453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.062622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.075263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da3c03-b83f-4548-aba8-804f4801d22a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.078930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 962/1934] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:32 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:33.079693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.080638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.081232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.081342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.081803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.082072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.082877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.085281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.104893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 973/1935] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:33.104893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.115837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807f731-6bc0-4452-9694-2d218b460e04 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.120535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.121321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.121675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.122026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.122833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.124543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.134627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 974/1936] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:33.135518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.139924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d016f-dd23-4f9b-b2f4-295b8ee482d0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.143922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.144655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.145018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.145367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.145461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f701c40-8bb0-4794-9b3c-8b8fa4ffce38 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.149887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489a9c5-4c36-4538-9455-5399e3541252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.150733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a9c5-4c36-4538-9455-5399e3541252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.151019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a9c5-4c36-4538-9455-5399e3541252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.151327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a9c5-4c36-4538-9455-5399e3541252 admin admin] PATH_INFO: `/v3/projects/cb147e3e14d949a09f43a72b4672dac8/users/152d83ec75e14f019a55ce21de2b688e/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.155294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.157000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.170350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 963/1937] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:33.170858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489a9c5-4c36-4538-9455-5399e3541252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb147e3e14d949a09f43a72b4672dac8, user_id=152d83ec75e14f019a55ce21de2b688e, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.171312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.173788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489a9c5-4c36-4538-9455-5399e3541252 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.182377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e696e86-94b7-48a7-8fe6-cf6402fc9cde service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.188411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.189103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.189392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.189671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.190410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.192067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.192987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 975/1938] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:33 2022] PUT /identity/v3/projects/cb147e3e14d949a09f43a72b4672dac8/users/152d83ec75e14f019a55ce21de2b688e/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:33.204109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 964/1939] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:33.206022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce45e5e-cf13-4bb8-92fc-9a5bdb13f643 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.206464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce45e5e-cf13-4bb8-92fc-9a5bdb13f643 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.206908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce45e5e-cf13-4bb8-92fc-9a5bdb13f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.209685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.223838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39da17-2966-4f3a-83b9-d479f21a576c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.245289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6ce45e5e-cf13-4bb8-92fc-9a5bdb13f643 None None] MFA Rules not processed for user `152d83ec75e14f019a55ce21de2b688e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:33.246946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6ce45e5e-cf13-4bb8-92fc-9a5bdb13f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.296637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.297922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.298216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.298503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] PATH_INFO: `/v3/projects/3c4395473a154ccf8024b1622d4a65af/users/0c25ff24dd14436c86ea3c3b3b00f239/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.318573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4395473a154ccf8024b1622d4a65af, user_id=0c25ff24dd14436c86ea3c3b3b00f239, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.321679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.340271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 965/1940] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:33 2022] PUT /identity/v3/projects/3c4395473a154ccf8024b1622d4a65af/users/0c25ff24dd14436c86ea3c3b3b00f239/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:33.348598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 976/1941] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:33.351307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.352258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.352730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.353274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.387158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] MFA Rules not processed for user `0c25ff24dd14436c86ea3c3b3b00f239`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:33.388832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.431033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e46543-ccce-4829-a7a2-12da0b487c27 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.442508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.443229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.443519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.443800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.444514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.446484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.479852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 977/1942] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:33.484778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.485383 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 966/1943] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:33 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:33.489923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.502693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97545e-2bed-4f9c-975a-b5e90c8dec8d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.584874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.585490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.585936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.586394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.587156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.589032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ed9f-908b-42c0-a241-afb14ab714ad admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.591234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.599593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.600287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.600577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.602646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.603396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.605350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.625513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 978/1944] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:33 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:33.626450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.628057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.635136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 967/1945] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:33 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:33.638779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.648397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d49f-96e3-4e05-be87-460cfab8a2a9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.711304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214768-2a24-4f17-87cb-bf36992169d8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.717777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.718962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.719350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.719629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] PATH_INFO: `/v3/projects/54ab62bb70a3448595a56b1c8fde0ad9` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.721270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ab62bb70a3448595a56b1c8fde0ad9)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.726218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.727594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.728056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.728335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.728633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.729483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.731688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.768324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 968/1946] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:33 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:33.768324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.782390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d75f98-86c9-4700-bdd5-1e40f61e3d66 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.800748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ab62bb70a3448595a56b1c8fde0ad9', 'request_id': 'req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.811600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ab62bb70a3448595a56b1c8fde0ad9', 'request_id': 'req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.825577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ab62bb70a3448595a56b1c8fde0ad9', 'request_id': 'req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.847410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] The token cache is being invalidate because project 54ab62bb70a3448595a56b1c8fde0ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:33.847893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.848599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.850263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 979/1947] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:33 2022] DELETE /identity/v3/projects/54ab62bb70a3448595a56b1c8fde0ad9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:33.851137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.852545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.860697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.861368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.861655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.861933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.862676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.864352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.877935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 969/1948] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:33.878966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.880919 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.894468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391fe50-8d53-49bc-a837-6cc1013b1ee4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.899143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.900022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.900312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.900579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] PATH_INFO: `/v3/users/f34914b248614d998ed58df94c4c870c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.901779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34914b248614d998ed58df94c4c870c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.903746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.921132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd311e5a-a0f8-49ab-94fd-3cc4d9aedd2c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.929194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.930006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.930295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.930571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.931368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.933033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.947235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 980/1949] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:33.947235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.947235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.953772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34914b248614d998ed58df94c4c870c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.959636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0d759-0f73-4c98-989f-98df0897186f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:33.964824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:33.965202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34914b248614d998ed58df94c4c870c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.965468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:33.965755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:33.966035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:33.966759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:33.968403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:33.972854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34914b248614d998ed58df94c4c870c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.973649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34914b248614d998ed58df94c4c870c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.974270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34914b248614d998ed58df94c4c870c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:33.978754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 981/1950] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:33.983513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.985475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:33.988885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 970/1951] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:33 2022] DELETE /identity/v3/users/f34914b248614d998ed58df94c4c870c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:33.989954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:33.991428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:34.000292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19523-2f62-4eff-8b69-8e20e03da59a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.084308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.085226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.085510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.085788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] PATH_INFO: `/v3/projects/64b5cd3d3c8647aa8566bcb2bc046a04/users/76d3bf7e8fd84f45b93c9801069e3a91/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.097537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd328-5ad2-4a28-839a-c88e87365942 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.111203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608420b-4a12-42ff-ba9c-059b4709813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.112449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b5cd3d3c8647aa8566bcb2bc046a04, user_id=76d3bf7e8fd84f45b93c9801069e3a91, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.112624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608420b-4a12-42ff-ba9c-059b4709813e admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.113115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608420b-4a12-42ff-ba9c-059b4709813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.113535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608420b-4a12-42ff-ba9c-059b4709813e admin admin] PATH_INFO: `/v3/projects/8f9a35744c3f445290397835151645df/users/0fccdbeac8b24a20a979c79ced46000e/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.119797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.143049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608420b-4a12-42ff-ba9c-059b4709813e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9a35744c3f445290397835151645df, user_id=0fccdbeac8b24a20a979c79ced46000e, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.147167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 982/1952] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:33 2022] PUT /identity/v3/projects/64b5cd3d3c8647aa8566bcb2bc046a04/users/76d3bf7e8fd84f45b93c9801069e3a91/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:34.151331 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.156384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608420b-4a12-42ff-ba9c-059b4709813e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.192151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 971/1953] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:33 2022] PUT /identity/v3/projects/8f9a35744c3f445290397835151645df/users/0fccdbeac8b24a20a979c79ced46000e/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:34.198980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.200926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.201333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.262587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] MFA Rules not processed for user `0fccdbeac8b24a20a979c79ced46000e`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:34.263993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:34.272235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05490679-cdf7-4e11-9553-4965947937df admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.352037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.352729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.353017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.353297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.354536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.357711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.377354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 983/1954] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:34.378639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.403392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8f00-dff9-451d-983c-2946dfe8fb85 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.414275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08f77c-1393-4d38-b385-3b3253b3480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.415213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f77c-1393-4d38-b385-3b3253b3480b admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.415492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f77c-1393-4d38-b385-3b3253b3480b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.415763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f77c-1393-4d38-b385-3b3253b3480b admin admin] PATH_INFO: `/v3/projects/64b5cd3d3c8647aa8566bcb2bc046a04/users/76d3bf7e8fd84f45b93c9801069e3a91/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.421940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 972/1955] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:34.422962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.426540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f77c-1393-4d38-b385-3b3253b3480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b5cd3d3c8647aa8566bcb2bc046a04, user_id=76d3bf7e8fd84f45b93c9801069e3a91, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.431027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f77c-1393-4d38-b385-3b3253b3480b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.451161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c25f-0698-4c38-aa8f-7a110890cefc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.481598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 984/1956] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:34 2022] PUT /identity/v3/projects/64b5cd3d3c8647aa8566bcb2bc046a04/users/76d3bf7e8fd84f45b93c9801069e3a91/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:34.483475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a457708-8893-4394-ae81-11d31c57274c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.484079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a457708-8893-4394-ae81-11d31c57274c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.487048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a457708-8893-4394-ae81-11d31c57274c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.562911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-1a457708-8893-4394-ae81-11d31c57274c None None] MFA Rules not processed for user `76d3bf7e8fd84f45b93c9801069e3a91`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:34.564224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1a457708-8893-4394-ae81-11d31c57274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:34.579829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.580640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.580941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.581905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.582878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.593013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.670647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 973/1957] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:34 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:34.675643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.702874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 985/1958] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:34.718383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a457708-8893-4394-ae81-11d31c57274c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.719884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1a457708-8893-4394-ae81-11d31c57274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:34.802374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a457708-8893-4394-ae81-11d31c57274c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.802824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67701463-1a1b-4d9e-8dc1-71b3b15edb18 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.808224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.809518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.809905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.810289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.811294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.813372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.839156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 974/1959] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:34 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:34.843179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.860389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed076b3d-8834-446e-9ef2-3f3f120ca70f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.875682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.876724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.876964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.877381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.878155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.880483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:34.897438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 975/1960] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:34.900876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.902003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.902126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:34.902624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.903564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.905025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:34.923227 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278a72-bbe3-4ab1-af6b-ab6cdc2ff87d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:34.929255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:34.930377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:34.930490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:34.930743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] PATH_INFO: `/v3/projects/4d6dbf71d23c4c468737abf91665af0a` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:34.932059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6dbf71d23c4c468737abf91665af0a)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:34.934703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.016297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6dbf71d23c4c468737abf91665af0a', 'request_id': 'req-f8521414-3cc2-4d0f-930d-c30fc1c361b3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:35.016510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.017922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.029253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 986/1961] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:35.030088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.037694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6dbf71d23c4c468737abf91665af0a', 'request_id': 'req-f8521414-3cc2-4d0f-930d-c30fc1c361b3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:35.047553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70106278-1da1-4ccb-bd0e-938c2ab02390 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.053559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6dbf71d23c4c468737abf91665af0a', 'request_id': 'req-f8521414-3cc2-4d0f-930d-c30fc1c361b3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:35.070481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] The token cache is being invalidate because project 4d6dbf71d23c4c468737abf91665af0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:35.070903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:35.072527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f8521414-3cc2-4d0f-930d-c30fc1c361b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:35.078294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 976/1962] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:34 2022] DELETE /identity/v3/projects/4d6dbf71d23c4c468737abf91665af0a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:35.080922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.081362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.081809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.106623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:35.107420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.151887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f432-1c7d-4944-9f32-99ff35dbe354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.152841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f432-1c7d-4944-9f32-99ff35dbe354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.153125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f432-1c7d-4944-9f32-99ff35dbe354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.153403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f432-1c7d-4944-9f32-99ff35dbe354 admin admin] PATH_INFO: `/v3/projects/22ca2ff1091e43838b8e147fa858403b/users/b2fb53fa1013403dace7f81dcd7b188a/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.167784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989f432-1c7d-4944-9f32-99ff35dbe354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca2ff1091e43838b8e147fa858403b, user_id=b2fb53fa1013403dace7f81dcd7b188a, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.171004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989f432-1c7d-4944-9f32-99ff35dbe354 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.174941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 977/1963] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:35.175661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.177201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.189002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 987/1964] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:35 2022] PUT /identity/v3/projects/22ca2ff1091e43838b8e147fa858403b/users/b2fb53fa1013403dace7f81dcd7b188a/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:35.190376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.190668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.190948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.208673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:35.211148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.239299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17111003-c364-4ddd-b1c3-685864e7116f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.269613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 988/1965] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:35.273257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.273257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.283413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9e6bb-f99e-42ee-b64b-242238e3e57c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.287988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.288638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.288916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.289201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.289910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.290166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.290920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.291349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.291543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.291817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.294302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.304367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 989/1966] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:35.305324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.317688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90bddc-763c-4ccc-8aa2-462529c4deb1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.322370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.323015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.323331 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.323611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.324366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:35.324677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.326267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.338049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 990/1967] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:35.338825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.349354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6235a6-d255-4aa1-95ef-8b2f4f78c62c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.353953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d3ccf-f954-48e9-afe0-f78c2859aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.354836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3ccf-f954-48e9-afe0-f78c2859aaba admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.355132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3ccf-f954-48e9-afe0-f78c2859aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.355982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3ccf-f954-48e9-afe0-f78c2859aaba admin admin] PATH_INFO: `/v3/projects/22ca2ff1091e43838b8e147fa858403b/users/b2fb53fa1013403dace7f81dcd7b188a/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.356180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.357665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.357953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d3ccf-f954-48e9-afe0-f78c2859aaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca2ff1091e43838b8e147fa858403b, user_id=b2fb53fa1013403dace7f81dcd7b188a, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.360632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d3ccf-f954-48e9-afe0-f78c2859aaba admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.366470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 978/1968] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:35.367357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.372316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 991/1969] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:35 2022] PUT /identity/v3/projects/22ca2ff1091e43838b8e147fa858403b/users/b2fb53fa1013403dace7f81dcd7b188a/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:35.378243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71b55-7cf3-421b-a5cc-3f38c0702c9f service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.385178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.385385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.385823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.414730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] MFA Rules not processed for user `b2fb53fa1013403dace7f81dcd7b188a`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:35.416661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.458606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.459314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.459622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.460082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.460788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.462706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.493347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 979/1970] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:35 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:35.498258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.527713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 992/1971] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:35.542916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.566461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b1ed-61fe-4c98-8e42-706f9511d0e9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.571090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.571811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.572173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.572455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.573144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.575090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.604831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 980/1972] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:35 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:35.607649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.616896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246d9e-e368-4fa5-9088-403758e87495 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.624298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb247c-cb88-4ddc-b543-49fb20cb4ce1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.631251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.632290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.632590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.632877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.633631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.636081 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.655236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 981/1973] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:35.657901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.670174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed751-9c30-4242-ba1c-303691bd8193 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.680842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.681708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.681910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.682203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.683357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.686330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.698213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 982/1974] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:35.712148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.713266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.713623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.713969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.724012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:35.742371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bf76a-afc1-4f5d-9054-a5765e1373f5 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:35.752874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397711-ce44-4a45-9bff-7ec833e7df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:35.756862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397711-ce44-4a45-9bff-7ec833e7df3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.756862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397711-ce44-4a45-9bff-7ec833e7df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.756862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397711-ce44-4a45-9bff-7ec833e7df3a admin admin] PATH_INFO: `/v3/projects/7d4ce69ae44f4a7db9f18fa4e8257924/users/ed9388777ac4481fbbc50490c1bf24f7/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.795304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397711-ce44-4a45-9bff-7ec833e7df3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4ce69ae44f4a7db9f18fa4e8257924, user_id=ed9388777ac4481fbbc50490c1bf24f7, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.801486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397711-ce44-4a45-9bff-7ec833e7df3a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.834691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 983/1975] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:35 2022] PUT /identity/v3/projects/7d4ce69ae44f4a7db9f18fa4e8257924/users/ed9388777ac4481fbbc50490c1bf24f7/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:35.844088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:35.844516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:35.844807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:35.848489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:35.850132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:35.864987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 993/1976] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:35.903469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] MFA Rules not processed for user `ed9388777ac4481fbbc50490c1bf24f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:35.904896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:35.995887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 984/1977] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:36.027141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:36.027141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:36.038364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f74bbe-c3b8-44d7-8b5c-c4e0bc404701 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:36.106946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:36.107798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:36.108110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:36.108449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:36.117649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:36.119206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:36.131218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 994/1978] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:36.678615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:36.689201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e124-106c-423e-ab49-ce1aad054ea9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:36.692796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:36.693337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:36.693697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:36.693879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:36.695692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:36.760652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:36.762424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2bda8-1bce-4596-a3d0-1d0a18d812bf service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:36.772766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 985/1979] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:38.256427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:38.257936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:38.328795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6bf38-06c0-43cf-ad1f-f562c8535f15 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:38.333869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:38.334970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:38.335236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:38.335510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] PATH_INFO: `/v3/users/0c25ff24dd14436c86ea3c3b3b00f239` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:38.336740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c25ff24dd14436c86ea3c3b3b00f239)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:38.338673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:38.395360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c25ff24dd14436c86ea3c3b3b00f239'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:38.408785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c25ff24dd14436c86ea3c3b3b00f239'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:38.420540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c25ff24dd14436c86ea3c3b3b00f239'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:38.421483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c25ff24dd14436c86ea3c3b3b00f239'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:38.432489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c25ff24dd14436c86ea3c3b3b00f239'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:38.446630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 995/1980] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:38 2022] DELETE /identity/v3/users/0c25ff24dd14436c86ea3c3b3b00f239 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:38.450009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:38.450522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:38.450808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:38.483602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:38.484983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:38.561747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 986/1981] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:38.573140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:38.575297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:38.653538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7b21-38d6-47f0-a57e-888fb9f80d7a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:38.675367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:38.676245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:38.676538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:38.676820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:38.706096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:38.707763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:38.729519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 996/1982] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:39.204469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:39.206003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:39.225329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b29b-c4ff-4a4b-b24c-b43593f88a39 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:39.256125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:39.257297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:39.257669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:39.258032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] PATH_INFO: `/v3/projects/3c4395473a154ccf8024b1622d4a65af` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:39.261557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4395473a154ccf8024b1622d4a65af)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:39.264360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:39.388022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4395473a154ccf8024b1622d4a65af', 'request_id': 'req-85f4f155-f25d-4a9e-a907-296712621e2c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.411638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4395473a154ccf8024b1622d4a65af', 'request_id': 'req-85f4f155-f25d-4a9e-a907-296712621e2c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.428607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4395473a154ccf8024b1622d4a65af', 'request_id': 'req-85f4f155-f25d-4a9e-a907-296712621e2c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.442206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] The token cache is being invalidate because project 3c4395473a154ccf8024b1622d4a65af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:39.442687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.443606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.446027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 987/1983] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:39 2022] DELETE /identity/v3/projects/3c4395473a154ccf8024b1622d4a65af => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:39.450461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:39.466122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148e4f-8f27-4b6c-b2e1-897dc5aaca61 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:39.536832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:39.537981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:39.538405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:39.538879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] PATH_INFO: `/v3/users/76d3bf7e8fd84f45b93c9801069e3a91` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:39.540321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d3bf7e8fd84f45b93c9801069e3a91)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:39.542529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:39.596590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d3bf7e8fd84f45b93c9801069e3a91'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.608064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d3bf7e8fd84f45b93c9801069e3a91'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.617104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d3bf7e8fd84f45b93c9801069e3a91'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.617747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d3bf7e8fd84f45b93c9801069e3a91'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.625375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3a5d0c29-e9eb-454f-8b57-7a1df4e26968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d3bf7e8fd84f45b93c9801069e3a91'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:39.631920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 997/1984] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:39 2022] DELETE /identity/v3/users/76d3bf7e8fd84f45b93c9801069e3a91 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:40.402614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:40.404340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:40.433978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f155-f25d-4a9e-a907-296712621e2c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:40.545297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:40.546190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:40.546470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:40.546744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] PATH_INFO: `/v3/projects/64b5cd3d3c8647aa8566bcb2bc046a04` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:40.547982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b5cd3d3c8647aa8566bcb2bc046a04)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:40.550774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:40.615301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b5cd3d3c8647aa8566bcb2bc046a04', 'request_id': 'req-fe197597-fed5-40c2-9c30-fe400edf142a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:40.627693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b5cd3d3c8647aa8566bcb2bc046a04', 'request_id': 'req-fe197597-fed5-40c2-9c30-fe400edf142a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:40.639382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b5cd3d3c8647aa8566bcb2bc046a04', 'request_id': 'req-fe197597-fed5-40c2-9c30-fe400edf142a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:40.657658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] The token cache is being invalidate because project 64b5cd3d3c8647aa8566bcb2bc046a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:40.657987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:40.658708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fe197597-fed5-40c2-9c30-fe400edf142a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:40.661708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 988/1985] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:40 2022] DELETE /identity/v3/projects/64b5cd3d3c8647aa8566bcb2bc046a04 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:40.666733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:40.667323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:40.668411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:40.715917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:40.720418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:40.821389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 998/1986] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:40.829741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:40.830043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:40.830373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:40.851156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:40.852435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:40.868117 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 989/1987] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:40.875923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:40.937717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfafee-f4da-4fb5-afdd-60c816422a18 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:40.951551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:40.952280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:40.952709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:40.953060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:40.954300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:40.964316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:40.969993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.021470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 999/1988] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:41.025409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.042687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f6d8-a795-4204-a007-7d0ac70c602d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.047910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.048753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.049233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.049452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.050288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.052390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.102511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 990/1989] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:41 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:41.103604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.117219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b665a7b-d568-4791-8b07-ad908b529ff7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.181859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.182535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.182817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.183093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.183843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.185860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.206111 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1000/1990] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:41 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:41.210175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.222669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7cfff-bee4-4f57-bae7-08611870a118 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.228074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.228746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.229029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.229307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.230659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.232288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.245933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 991/1991] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:41.248604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.258748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136e4e9-b74e-4aa5-a48d-aaf97ddca0e6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.264291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de67b7-700a-4416-8e68-c27b0965b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.264966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de67b7-700a-4416-8e68-c27b0965b93f admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.265274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de67b7-700a-4416-8e68-c27b0965b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.265577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de67b7-700a-4416-8e68-c27b0965b93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.266529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de67b7-700a-4416-8e68-c27b0965b93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.268165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de67b7-700a-4416-8e68-c27b0965b93f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.283634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1001/1992] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:41.286456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.301356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580344ea-9a1e-43f2-a361-18f4cdd441c9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.306313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.307249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.307715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.307985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] PATH_INFO: `/v3/projects/8536eb3d67de4785be4bf5ee8fc98a54/users/832c212c21f04baa9dadc535fd4edd59/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.324969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8536eb3d67de4785be4bf5ee8fc98a54, user_id=832c212c21f04baa9dadc535fd4edd59, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.327938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.341857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 992/1993] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:41 2022] PUT /identity/v3/projects/8536eb3d67de4785be4bf5ee8fc98a54/users/832c212c21f04baa9dadc535fd4edd59/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:41.353144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.353440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.353726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.381171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] MFA Rules not processed for user `832c212c21f04baa9dadc535fd4edd59`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:41.382394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:41.449990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1002/1994] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:41.454181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.517892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2adc70-f577-434b-8c5c-bd0220720ccf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.526482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.527278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.527567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.527844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.528550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.531647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.564343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 993/1995] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:41 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:41.568652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.581302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac434c8-1c46-4c53-8a8e-faaa2bc2cbe5 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.652993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.653673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.653959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.654247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.654937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.656913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.679794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1003/1996] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:41 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:41.681666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.692368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41d677-3528-40d2-8bf4-8615536cebb7 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.696915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.697655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.698028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.698377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.699844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.701559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.711949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 994/1997] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:41.716558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.726562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924abad7-6823-4e8c-b438-1430549631e7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.731595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.732466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.732749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.733044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] PATH_INFO: `/v3/projects/bbec2a2efa674bb69f44251d23992cc1/users/4fcae7b20ee24cb38ee31f860b934a39/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.748917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbec2a2efa674bb69f44251d23992cc1, user_id=4fcae7b20ee24cb38ee31f860b934a39, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.751611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.764428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1004/1998] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:41 2022] PUT /identity/v3/projects/bbec2a2efa674bb69f44251d23992cc1/users/4fcae7b20ee24cb38ee31f860b934a39/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:41.768440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.778306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e77aa-d58b-49cb-9633-255fbf2207ea admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.840336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359355-1849-4cb8-b744-32d027e7e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.841191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359355-1849-4cb8-b744-32d027e7e8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.841485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359355-1849-4cb8-b744-32d027e7e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.841765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359355-1849-4cb8-b744-32d027e7e8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.842498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359355-1849-4cb8-b744-32d027e7e8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.844182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359355-1849-4cb8-b744-32d027e7e8a1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.854965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 995/1999] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:41.859703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:41.872720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0cac9-9b91-4375-aa71-ab7b76b13e1d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:41.878937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:41.880116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.880426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.880718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] PATH_INFO: `/v3/projects/bbec2a2efa674bb69f44251d23992cc1/users/4fcae7b20ee24cb38ee31f860b934a39/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.883630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbec2a2efa674bb69f44251d23992cc1, user_id=4fcae7b20ee24cb38ee31f860b934a39, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:41.888532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:41.904309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1005/2000] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:41 2022] PUT /identity/v3/projects/bbec2a2efa674bb69f44251d23992cc1/users/4fcae7b20ee24cb38ee31f860b934a39/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:41.915695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:41.916499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:41.916499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:41.949525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] MFA Rules not processed for user `4fcae7b20ee24cb38ee31f860b934a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:41.950904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:42.046584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 996/2001] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:42.055094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:42.057043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:42.128699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f36c-f9e7-4532-a336-3f5846b66970 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:42.132579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:42.133327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:42.133684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:42.134416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:42.155557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:42.157565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:42.169735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1006/2002] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:42.279043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:42.291694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158c1d-5fd5-4ec7-a513-30cd9889b73a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:42.298793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:42.300056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:42.300586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:42.301434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:42.377218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:42.378657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:42.387667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 997/2003] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:43.380666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:43.389138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbaee6-36b7-42a6-81e2-ab611b3784d9 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:43.393347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:43.393994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:43.394309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:43.394547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:43.396363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:43.454591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:43.456134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dbb31-aebc-4a9d-a092-d6256b8891ec service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:43.465024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1007/2004] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:45.534364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:45.535862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:45.598351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa674d-40f6-436f-97db-73f6ec03718c service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:45.603051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:45.603970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:45.604257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:45.604536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] PATH_INFO: `/v3/users/152d83ec75e14f019a55ce21de2b688e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:45.605790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152d83ec75e14f019a55ce21de2b688e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:45.607885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:45.668721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152d83ec75e14f019a55ce21de2b688e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:45.680245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152d83ec75e14f019a55ce21de2b688e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:45.689206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152d83ec75e14f019a55ce21de2b688e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:45.690537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152d83ec75e14f019a55ce21de2b688e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:45.695564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152d83ec75e14f019a55ce21de2b688e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:45.711003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 998/2005] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:45 2022] DELETE /identity/v3/users/152d83ec75e14f019a55ce21de2b688e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:45.715905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:45.716767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:45.717288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:45.746372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:45.747954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:45.837132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1008/2006] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:45.850948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:45.852547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:45.933685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71655914-6b08-4492-bc98-8b5872f50579 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:45.938453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a074-a382-449f-984b-6f3e3c3dfb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:45.939305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a074-a382-449f-984b-6f3e3c3dfb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:45.939718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a074-a382-449f-984b-6f3e3c3dfb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:45.940074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a074-a382-449f-984b-6f3e3c3dfb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:45.971366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a074-a382-449f-984b-6f3e3c3dfb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:45.973489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a074-a382-449f-984b-6f3e3c3dfb43 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:45.993419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 999/2007] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:46.014134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:46.017332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:46.034787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0fbf8-a394-41d8-b119-3acd70e5199a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:46.040219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:46.041342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:46.049104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:46.054590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] PATH_INFO: `/v3/users/832c212c21f04baa9dadc535fd4edd59` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:46.056848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=832c212c21f04baa9dadc535fd4edd59)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:46.061488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:46.136120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832c212c21f04baa9dadc535fd4edd59'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:46.153756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832c212c21f04baa9dadc535fd4edd59'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:46.165044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832c212c21f04baa9dadc535fd4edd59'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:46.166101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832c212c21f04baa9dadc535fd4edd59'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:46.175055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832c212c21f04baa9dadc535fd4edd59'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:46.187236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122951a5-525d-417b-9126-93b542de3f27 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:46.187836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122951a5-525d-417b-9126-93b542de3f27 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:46.188228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122951a5-525d-417b-9126-93b542de3f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:46.196615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1009/2008] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:46 2022] DELETE /identity/v3/users/832c212c21f04baa9dadc535fd4edd59 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:46.215591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-122951a5-525d-417b-9126-93b542de3f27 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:46.217059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-122951a5-525d-417b-9126-93b542de3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:46.319851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1000/2009] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:46.381553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:46.383683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:46.484492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7dda-4a52-4da5-b8ce-1d42517cb24f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:46.488421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:46.489657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:46.489953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:46.490342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:46.504029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:46.505586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:46.516493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1010/2010] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:46.948444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122951a5-525d-417b-9126-93b542de3f27 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:46.951538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-122951a5-525d-417b-9126-93b542de3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:46.978277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122951a5-525d-417b-9126-93b542de3f27 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:46.991852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:46.993102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:46.994046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:46.994494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] PATH_INFO: `/v3/projects/cb147e3e14d949a09f43a72b4672dac8` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:46.996578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb147e3e14d949a09f43a72b4672dac8)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:47.000137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:47.087343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb147e3e14d949a09f43a72b4672dac8', 'request_id': 'req-af60462b-c277-484e-b10d-8c664f7611ad'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.099568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb147e3e14d949a09f43a72b4672dac8', 'request_id': 'req-af60462b-c277-484e-b10d-8c664f7611ad'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.109615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb147e3e14d949a09f43a72b4672dac8', 'request_id': 'req-af60462b-c277-484e-b10d-8c664f7611ad'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.129692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] The token cache is being invalidate because project cb147e3e14d949a09f43a72b4672dac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:47.130124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.131018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.135162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1001/2011] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:46 2022] DELETE /identity/v3/projects/cb147e3e14d949a09f43a72b4672dac8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:47.138234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:47.153268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:47.155175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:47.156546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768b55-a3c1-48cd-804e-6897282fb62e service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:47.237893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:47.239419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:47.240621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:47.241058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] PATH_INFO: `/v3/users/0fccdbeac8b24a20a979c79ced46000e` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:47.242673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fccdbeac8b24a20a979c79ced46000e)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:47.245058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:47.256782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60462b-c277-484e-b10d-8c664f7611ad admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:47.262434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:47.263341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:47.263614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:47.264377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] PATH_INFO: `/v3/projects/8536eb3d67de4785be4bf5ee8fc98a54` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:47.265101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8536eb3d67de4785be4bf5ee8fc98a54)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:47.267310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:47.314248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fccdbeac8b24a20a979c79ced46000e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.327229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fccdbeac8b24a20a979c79ced46000e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.328457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8536eb3d67de4785be4bf5ee8fc98a54', 'request_id': 'req-140a117d-ec2e-4c8c-a788-84f1bc03599b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.336465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fccdbeac8b24a20a979c79ced46000e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.337220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fccdbeac8b24a20a979c79ced46000e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.341416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8536eb3d67de4785be4bf5ee8fc98a54', 'request_id': 'req-140a117d-ec2e-4c8c-a788-84f1bc03599b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.344927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fccdbeac8b24a20a979c79ced46000e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.348280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8536eb3d67de4785be4bf5ee8fc98a54', 'request_id': 'req-140a117d-ec2e-4c8c-a788-84f1bc03599b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.351226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1011/2012] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:47 2022] DELETE /identity/v3/users/0fccdbeac8b24a20a979c79ced46000e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:47.361253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] The token cache is being invalidate because project 8536eb3d67de4785be4bf5ee8fc98a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:47.361633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.362368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.366828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1002/2013] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:47 2022] DELETE /identity/v3/projects/8536eb3d67de4785be4bf5ee8fc98a54 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:47.368057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:47.369461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:47.485314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fea06-919b-47ea-8ef8-427ae75c7d8e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:47.491289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:47.492688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:47.493240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:47.493855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] PATH_INFO: `/v3/users/4fcae7b20ee24cb38ee31f860b934a39` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:47.496732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcae7b20ee24cb38ee31f860b934a39)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:47.499343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:47.566688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcae7b20ee24cb38ee31f860b934a39'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.584306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcae7b20ee24cb38ee31f860b934a39'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.608370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcae7b20ee24cb38ee31f860b934a39'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.609055 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcae7b20ee24cb38ee31f860b934a39'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.619839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcae7b20ee24cb38ee31f860b934a39'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:47.635457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1012/2014] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:47 2022] DELETE /identity/v3/users/4fcae7b20ee24cb38ee31f860b934a39 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:47.788669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:47.791679 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:47.885313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a117d-ec2e-4c8c-a788-84f1bc03599b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:47.954506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:47.954988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:47.955419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:47.955545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] PATH_INFO: `/v3/projects/8f9a35744c3f445290397835151645df` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:47.956939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9a35744c3f445290397835151645df)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:47.958882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:48.043294 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9a35744c3f445290397835151645df', 'request_id': 'req-aed39ae2-0d05-465e-afaa-66370a071a16'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.053741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9a35744c3f445290397835151645df', 'request_id': 'req-aed39ae2-0d05-465e-afaa-66370a071a16'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.064193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9a35744c3f445290397835151645df', 'request_id': 'req-aed39ae2-0d05-465e-afaa-66370a071a16'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.077038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] The token cache is being invalidate because project 8f9a35744c3f445290397835151645df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:48.077627 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.078468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.080712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1003/2015] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:47 2022] DELETE /identity/v3/projects/8f9a35744c3f445290397835151645df => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:48.084858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:48.086299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:48.135375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04acb-f1fc-4182-beb0-df63abb0a7e3 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:48.177373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:48.179032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:48.269230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:48.271492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.271985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.272990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] PATH_INFO: `/v3/users/b2fb53fa1013403dace7f81dcd7b188a` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.274750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fb53fa1013403dace7f81dcd7b188a)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:48.281027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:48.284071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39ae2-0d05-465e-afaa-66370a071a16 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:48.288881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:48.289892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.290188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.290476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] PATH_INFO: `/v3/projects/bbec2a2efa674bb69f44251d23992cc1` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.291881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbec2a2efa674bb69f44251d23992cc1)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:48.293852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:48.361443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fb53fa1013403dace7f81dcd7b188a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.376959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fb53fa1013403dace7f81dcd7b188a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.386124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbec2a2efa674bb69f44251d23992cc1', 'request_id': 'req-e782f8be-648c-499e-912d-45f890c96645'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.395002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fb53fa1013403dace7f81dcd7b188a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.395666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fb53fa1013403dace7f81dcd7b188a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.405973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbec2a2efa674bb69f44251d23992cc1', 'request_id': 'req-e782f8be-648c-499e-912d-45f890c96645'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.415198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-382dcbda-5dce-4f7e-8dbe-9cc0441dca80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fb53fa1013403dace7f81dcd7b188a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.417910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbec2a2efa674bb69f44251d23992cc1', 'request_id': 'req-e782f8be-648c-499e-912d-45f890c96645'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.429176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1013/2016] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:48 2022] DELETE /identity/v3/users/b2fb53fa1013403dace7f81dcd7b188a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:48.450472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] The token cache is being invalidate because project bbec2a2efa674bb69f44251d23992cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:48.450853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.451669 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e782f8be-648c-499e-912d-45f890c96645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:48.457183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1004/2017] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:48 2022] DELETE /identity/v3/projects/bbec2a2efa674bb69f44251d23992cc1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:48.461129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.461718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.462199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.493062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:48.494409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:48.585085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1014/2018] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:48.587662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.588075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.589460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.614626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:48.620238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:48.631309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1005/2019] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:48.636766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:48.652928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3462e6-2411-4faa-a3f2-8183e2345a6b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:48.663630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:48.664335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.664745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.665031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.665872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:48.666065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:48.668253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:48.684730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1015/2020] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:48.689705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:48.700425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5b05-de88-48bf-9819-deecae3daf21 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:48.705776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:48.706459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.706745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.707023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.708801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:48.711404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:48.756670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1006/2021] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:48 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:48.757709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:48.770158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d119fe0-84f2-4884-9507-52da42f3ee85 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:48.871646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:48.874048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:48.906963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:48.907829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:48.908105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:48.908397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:48.909176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:48.911097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:48.970989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1016/2022] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:48 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:48.971977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.002922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2173e-748f-414d-9eac-25d627592193 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.017842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.018936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.019469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.019848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.020837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.022556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.035159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1017/2023] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:49.038224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34211-b15c-4f10-b39c-7d23e0ce1085 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.040080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.047387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.048600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.049537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.049837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] PATH_INFO: `/v3/projects/22ca2ff1091e43838b8e147fa858403b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.051095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ca2ff1091e43838b8e147fa858403b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.053610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.055185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67702-70d5-4d43-b43d-149bdd037761 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.064008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.064947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.065226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.065517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.066516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.068585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.084582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1018/2024] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:49.088805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.105804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f87c-d853-4848-b803-ba882b76debc admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.126096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ca2ff1091e43838b8e147fa858403b', 'request_id': 'req-06616051-2498-4036-af09-a4cfc1255c40'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:49.141460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ca2ff1091e43838b8e147fa858403b', 'request_id': 'req-06616051-2498-4036-af09-a4cfc1255c40'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:49.149659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ca2ff1091e43838b8e147fa858403b', 'request_id': 'req-06616051-2498-4036-af09-a4cfc1255c40'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:49.161394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] The token cache is being invalidate because project 22ca2ff1091e43838b8e147fa858403b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:49.161774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:49.162684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-06616051-2498-4036-af09-a4cfc1255c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:49.164813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1007/2025] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:48 2022] DELETE /identity/v3/projects/22ca2ff1091e43838b8e147fa858403b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:49.170754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842419b-51c6-4b57-a683-cb1bcb9dc238 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.171332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842419b-51c6-4b57-a683-cb1bcb9dc238 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.171621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842419b-51c6-4b57-a683-cb1bcb9dc238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.175453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe5ba0-c25b-4bb5-a3e7-6bd42df202d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.176345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5ba0-c25b-4bb5-a3e7-6bd42df202d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.176626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5ba0-c25b-4bb5-a3e7-6bd42df202d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.176900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5ba0-c25b-4bb5-a3e7-6bd42df202d6 admin admin] PATH_INFO: `/v3/projects/3677f27047074dac9ebc389ea15a849e/users/c1cdea809eba4d2ab8fc49fcf6d3eaf8/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.191325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c842419b-51c6-4b57-a683-cb1bcb9dc238 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:49.192435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5ba0-c25b-4bb5-a3e7-6bd42df202d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3677f27047074dac9ebc389ea15a849e, user_id=c1cdea809eba4d2ab8fc49fcf6d3eaf8, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.193066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c842419b-51c6-4b57-a683-cb1bcb9dc238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.198344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5ba0-c25b-4bb5-a3e7-6bd42df202d6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.201885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1008/2026] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:49.211538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.211831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.212162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.219877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1019/2027] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:49 2022] PUT /identity/v3/projects/3677f27047074dac9ebc389ea15a849e/users/c1cdea809eba4d2ab8fc49fcf6d3eaf8/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:49.230664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.230969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.231329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.234949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:49.236557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.265776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] MFA Rules not processed for user `c1cdea809eba4d2ab8fc49fcf6d3eaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:49.267343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.307002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1009/2028] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:49.312451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.324305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8bb06-0672-4d5b-a2be-aec9209c466a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.329078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.329883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.330205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.330558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.331398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:49.331769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.333447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.344372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1020/2029] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:49.347445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.349021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.353107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1010/2030] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:49.355438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.365801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922e337-9a8c-4d34-a4f6-00284559f899 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.368151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0917-1b4f-473d-acb2-41325da929fc admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.370516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.371745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.372032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.372310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.373007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.373491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.374154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.374479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.374758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.374936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.375490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.377415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.402875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1021/2031] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:49.406956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.410672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1011/2032] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:49.416462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.481329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72878d0-4559-43e1-b20c-c7916fb3b1e0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.491929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.492866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.493371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.494013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.495145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.497242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c07750-7e4e-41b4-a875-83cb1efb7712 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.497796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.502705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.503440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.503728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.504005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.504695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.509072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.527006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1022/2033] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:49.531060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.544887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57e40b-db11-421c-8ca4-7ec29c52a5a5 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.547551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1012/2034] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:49.549884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.550705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.551004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.551313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.552128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.552379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.553709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.564268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553189e7-1308-41c4-bed0-0ef3e64ce330 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.567271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1023/2035] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:49.569187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.571948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.572894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.572894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.573262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.574175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.575950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.579957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfb189-8d55-4c10-a332-26d1064c6b30 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.584957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.585785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.586096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.586448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] PATH_INFO: `/v3/projects/b2eb1ab9a011434d949bb4bea66d7d7a/users/628455db644345f586057e1623136450/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.587820 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1013/2036] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:49.592177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.602116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c8f4-42fa-44d0-8639-9d9e4cf5c199 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.604133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2eb1ab9a011434d949bb4bea66d7d7a, user_id=628455db644345f586057e1623136450, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.608098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.608327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.608777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.609066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.609343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.610075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.614685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.625935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1014/2037] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:49.627534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1024/2038] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:49 2022] PUT /identity/v3/projects/b2eb1ab9a011434d949bb4bea66d7d7a/users/628455db644345f586057e1623136450/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:49.632770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.633315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.649312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffb86c-15c1-4bea-a8f4-1d3d1f83a339 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.695835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04597a-7344-4f47-94cf-efb558d552d6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.700470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae386c-ec2b-4b6c-aa22-c69fb9fdd506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.701347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae386c-ec2b-4b6c-aa22-c69fb9fdd506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.701630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae386c-ec2b-4b6c-aa22-c69fb9fdd506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.701961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae386c-ec2b-4b6c-aa22-c69fb9fdd506 admin admin] PATH_INFO: `/v3/projects/13c5f0cdda4f47698be699d0210b5b1c/users/6b9a9606e343490a81380af231a5457e/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.709235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.709907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.710191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.710468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.711223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.712956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.716254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae386c-ec2b-4b6c-aa22-c69fb9fdd506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c5f0cdda4f47698be699d0210b5b1c, user_id=6b9a9606e343490a81380af231a5457e, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.718923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae386c-ec2b-4b6c-aa22-c69fb9fdd506 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.724371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1015/2039] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:49.728827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.733220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1025/2040] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:49 2022] PUT /identity/v3/projects/13c5f0cdda4f47698be699d0210b5b1c/users/6b9a9606e343490a81380af231a5457e/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:49.741221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bce01-6f5c-471c-b50f-c94e341b7b63 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.744132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.744421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.744701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.770681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] MFA Rules not processed for user `6b9a9606e343490a81380af231a5457e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:49.771899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.796839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f83e1-61c9-42d3-9d4b-d0bd0d274c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.797761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f83e1-61c9-42d3-9d4b-d0bd0d274c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.798054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f83e1-61c9-42d3-9d4b-d0bd0d274c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.798358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f83e1-61c9-42d3-9d4b-d0bd0d274c62 admin admin] PATH_INFO: `/v3/projects/b2eb1ab9a011434d949bb4bea66d7d7a/users/628455db644345f586057e1623136450/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.800478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f83e1-61c9-42d3-9d4b-d0bd0d274c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2eb1ab9a011434d949bb4bea66d7d7a, user_id=628455db644345f586057e1623136450, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.803167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f83e1-61c9-42d3-9d4b-d0bd0d274c62 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.813793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1016/2041] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:49 2022] PUT /identity/v3/projects/b2eb1ab9a011434d949bb4bea66d7d7a/users/628455db644345f586057e1623136450/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:49.824389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.824682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.824965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.838643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1026/2042] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:49.843376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.852227 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] MFA Rules not processed for user `628455db644345f586057e1623136450`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:49.853442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.853575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49ce88-6e21-4d13-9084-ab6bc6590695 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:49.910622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:49.911557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:49.911840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:49.912110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:49.912867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:49.915240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:49.923350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1017/2043] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:49.935259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.936872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:49.941698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1027/2044] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:49.945597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:49.999301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59196c05-9369-4bd8-b151-54139ee78ffb None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.012696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c7538-edd9-462e-8d09-d0493575b9fb admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.018324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.018699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.018931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.019583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.019938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.021856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.050031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1028/2045] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:49 2022] POST /identity/v3/users => generated 306 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:50.050942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.064561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5a31-7dd0-4ba1-a78a-548feceff790 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.069141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.069795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.070083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.070350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.070707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.071394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.071487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.071684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.071967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.073351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.084625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1029/2046] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:50.088590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.099396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d797-e4ed-43ab-97f9-e27d7a665e76 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.104067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.105200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.105479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.106150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] PATH_INFO: `/v3/projects/5fc59b64f09e42adb4786d06b4310802/users/0684558b259f4889956886552d41eba7/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.121347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc59b64f09e42adb4786d06b4310802, user_id=0684558b259f4889956886552d41eba7, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.124162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.140314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.140428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1030/2047] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:50 2022] PUT /identity/v3/projects/5fc59b64f09e42adb4786d06b4310802/users/0684558b259f4889956886552d41eba7/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:50.140507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.143013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.150671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1018/2048] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:50.205344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec7e8-1efc-4b2f-889a-5f9931f97b1f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.210143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e44cda-abdd-4679-b42a-cf5129fd9bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.210723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e44cda-abdd-4679-b42a-cf5129fd9bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.214131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e44cda-abdd-4679-b42a-cf5129fd9bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.214131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e44cda-abdd-4679-b42a-cf5129fd9bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.214131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e44cda-abdd-4679-b42a-cf5129fd9bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.214131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e44cda-abdd-4679-b42a-cf5129fd9bc1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.235310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1031/2049] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:43:50.239716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.253706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5447df5-7e5c-4bba-a7ad-be1087b2a363 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.260995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.262569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.263326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.263681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] PATH_INFO: `/v3/projects/5fc59b64f09e42adb4786d06b4310802/users/0684558b259f4889956886552d41eba7/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.268498 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc59b64f09e42adb4786d06b4310802, user_id=0684558b259f4889956886552d41eba7, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.274427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.292002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1019/2050] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:50 2022] PUT /identity/v3/projects/5fc59b64f09e42adb4786d06b4310802/users/0684558b259f4889956886552d41eba7/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:50.303564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.303854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.304137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.344104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] MFA Rules not processed for user `0684558b259f4889956886552d41eba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:50.344954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:50.472491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1032/2051] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:50.485429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.581502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdeab5-adc9-4e36-971a-7d0447644dd3 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.585675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.586557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.587029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.587357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.599957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.601805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.615357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1020/2052] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:50.682436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.705813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:50.715339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2ec7-0ac6-4c80-9dde-f8171eb91275 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.733603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd037d-1dd7-4826-9cdf-a16e6df8cefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.736085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd037d-1dd7-4826-9cdf-a16e6df8cefd service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.738145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd037d-1dd7-4826-9cdf-a16e6df8cefd service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.738910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd037d-1dd7-4826-9cdf-a16e6df8cefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.778343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f76ee-9730-4816-9c3e-c9a6adefed75 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:50.795915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:50.796876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.797116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.797498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] PATH_INFO: `/v3/users/c1cdea809eba4d2ab8fc49fcf6d3eaf8` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.798684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cdea809eba4d2ab8fc49fcf6d3eaf8)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.800798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.820776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd037d-1dd7-4826-9cdf-a16e6df8cefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:50.822332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd037d-1dd7-4826-9cdf-a16e6df8cefd service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:50.840248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1021/2053] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:50.872050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cdea809eba4d2ab8fc49fcf6d3eaf8'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:50.889169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cdea809eba4d2ab8fc49fcf6d3eaf8'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:50.900218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cdea809eba4d2ab8fc49fcf6d3eaf8'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:50.901283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cdea809eba4d2ab8fc49fcf6d3eaf8'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:50.909234 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cdea809eba4d2ab8fc49fcf6d3eaf8'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:50.917217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1033/2054] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:50 2022] DELETE /identity/v3/users/c1cdea809eba4d2ab8fc49fcf6d3eaf8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:50.922194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:50.922481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:50.922764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:50.941467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:50.943947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.026981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1022/2055] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:51.037721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.039853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.119687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7ef2d-322d-4527-89b7-dd619a32788b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.137269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.137992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.138283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.138714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.149308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.150795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.161917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.164422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.170733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c5058-e552-47da-922f-e1ae813fe7de None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.179725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.180698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.181075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.181418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] PATH_INFO: `/v3/users/2bcb01a31f7e46e7867eb1bbc2fb1d6b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.181770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1034/2056] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:51.183181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bcb01a31f7e46e7867eb1bbc2fb1d6b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.185320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.259815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bcb01a31f7e46e7867eb1bbc2fb1d6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.272660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bcb01a31f7e46e7867eb1bbc2fb1d6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.281606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bcb01a31f7e46e7867eb1bbc2fb1d6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.282279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bcb01a31f7e46e7867eb1bbc2fb1d6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.283054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bcb01a31f7e46e7867eb1bbc2fb1d6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.297158 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1023/2057] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:51 2022] DELETE /identity/v3/users/2bcb01a31f7e46e7867eb1bbc2fb1d6b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:51.465785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.468456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.481949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2cf54-51d7-4eb3-910b-4671f0beb08b service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.485057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.488443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.570471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.571355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.571635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.571909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] PATH_INFO: `/v3/projects/3677f27047074dac9ebc389ea15a849e` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.573072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3677f27047074dac9ebc389ea15a849e)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.575579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.576716 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1c6b9-726f-4aae-bd10-fac6703112d9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.581388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.582250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.582531 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.582821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] PATH_INFO: `/v3/projects/8e071a15822f4ffa90e9716ec2239e45` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.584021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e071a15822f4ffa90e9716ec2239e45)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.585908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.623692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3677f27047074dac9ebc389ea15a849e', 'request_id': 'req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.631338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3677f27047074dac9ebc389ea15a849e', 'request_id': 'req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.635365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e071a15822f4ffa90e9716ec2239e45', 'request_id': 'req-122e7554-b478-4eba-bc98-4f33d7fb76a3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.637257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3677f27047074dac9ebc389ea15a849e', 'request_id': 'req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.643360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e071a15822f4ffa90e9716ec2239e45', 'request_id': 'req-122e7554-b478-4eba-bc98-4f33d7fb76a3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.648698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] The token cache is being invalidate because project 3677f27047074dac9ebc389ea15a849e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:51.648836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e071a15822f4ffa90e9716ec2239e45', 'request_id': 'req-122e7554-b478-4eba-bc98-4f33d7fb76a3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.649159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.649865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.651531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1035/2058] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:51 2022] DELETE /identity/v3/projects/3677f27047074dac9ebc389ea15a849e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:51.656419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.657801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.660694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] The token cache is being invalidate because project 8e071a15822f4ffa90e9716ec2239e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:51.660990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.661661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-122e7554-b478-4eba-bc98-4f33d7fb76a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.663238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1024/2059] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:51 2022] DELETE /identity/v3/projects/8e071a15822f4ffa90e9716ec2239e45 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:51.667989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddebd5-1bdb-468f-b618-351c9d25ba6f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.668357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddebd5-1bdb-468f-b618-351c9d25ba6f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.668714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddebd5-1bdb-468f-b618-351c9d25ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.692626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2fddebd5-1bdb-468f-b618-351c9d25ba6f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:51.693955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2fddebd5-1bdb-468f-b618-351c9d25ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.733775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072735-a46f-42c4-8cb6-e7d6d1dc6e26 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.754161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1025/2060] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:51.762553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.762775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.763059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.781346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:51.782639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.790792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1026/2061] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:51.790938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.791992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.792360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.792643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] PATH_INFO: `/v3/users/628455db644345f586057e1623136450` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.794228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=628455db644345f586057e1623136450)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.794823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.796267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.803887 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da58578-0db1-4b57-bda5-d5e77f9c9915 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.809122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.809784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.810067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.810343 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.811163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:51.811472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.813148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.825507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1027/2062] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:43:51.829726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.839479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0a39-6dda-4b56-9625-298a7827c22a admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:51.844375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:51.845023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:51.845314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:51.845587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:51.846271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:51.848257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:51.848540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628455db644345f586057e1623136450'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.860732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628455db644345f586057e1623136450'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.868345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628455db644345f586057e1623136450'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.869117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628455db644345f586057e1623136450'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.875615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1028/2063] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:51 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:51.876947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628455db644345f586057e1623136450'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:51.880330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:51.882269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:51.883628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1036/2064] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:51 2022] DELETE /identity/v3/users/628455db644345f586057e1623136450 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:51.962384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261514b-c3a8-41e5-bb78-48a8c8245f5e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.029593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.030293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.030616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.030905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.031767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.033964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.064451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1029/2065] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:51 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:52.068703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.080264 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb366922-4131-4ea0-a87b-6f339e1996ac admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.084884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.085542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.085821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.086095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.086817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.088453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.098455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1037/2066] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:52.102849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.112984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672901c-9646-4f11-92ba-48f761b16e5c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.117673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.118208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.118490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.118764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.119585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.121762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.131707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1030/2067] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:52.135869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.146824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74740fa7-0c8f-4d0a-81b7-82ff1e583e6e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.152090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce5f9e-5f49-4d49-9301-c3deb3b96f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.153018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce5f9e-5f49-4d49-9301-c3deb3b96f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.153324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce5f9e-5f49-4d49-9301-c3deb3b96f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.153725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce5f9e-5f49-4d49-9301-c3deb3b96f67 admin admin] PATH_INFO: `/v3/projects/619a903e035048f4bb5d9315cff91b7a/users/fa3948f301e84488b6c3f0a6dc069202/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.176368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.176875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce5f9e-5f49-4d49-9301-c3deb3b96f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619a903e035048f4bb5d9315cff91b7a, user_id=fa3948f301e84488b6c3f0a6dc069202, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.178207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.179463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce5f9e-5f49-4d49-9301-c3deb3b96f67 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.195441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b3369-7152-45a0-8d3d-276aaadc57bb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.198034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1038/2068] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:52 2022] PUT /identity/v3/projects/619a903e035048f4bb5d9315cff91b7a/users/fa3948f301e84488b6c3f0a6dc069202/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:52.203818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.204254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.204674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.228692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:52.230775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.267045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.268101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.268386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.268857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] PATH_INFO: `/v3/projects/b2eb1ab9a011434d949bb4bea66d7d7a` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.270114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2eb1ab9a011434d949bb4bea66d7d7a)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.272130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.297654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1039/2069] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:52.308696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.310248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.334441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2eb1ab9a011434d949bb4bea66d7d7a', 'request_id': 'req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:52.344923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2eb1ab9a011434d949bb4bea66d7d7a', 'request_id': 'req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:52.353002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2eb1ab9a011434d949bb4bea66d7d7a', 'request_id': 'req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:52.366949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] The token cache is being invalidate because project b2eb1ab9a011434d949bb4bea66d7d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:52.367403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:52.368181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e4bbfbdf-ecae-4a64-81d0-f9b59bfb769f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:52.370058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1031/2070] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:52 2022] DELETE /identity/v3/projects/b2eb1ab9a011434d949bb4bea66d7d7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:52.372289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdeb65-73e7-4ac3-a73a-69d74a96bd41 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.375204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66132-05a3-445e-ad82-680710835baf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.375535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66132-05a3-445e-ad82-680710835baf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.375891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66132-05a3-445e-ad82-680710835baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.396007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2ec66132-05a3-445e-ad82-680710835baf None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:52.397510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2ec66132-05a3-445e-ad82-680710835baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.429984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.430713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.430990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.431334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.434026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.471698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1032/2071] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:52.489866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.490366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.490821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.511647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:52.512916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.520393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.522287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.530103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1033/2072] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:52.531431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.544782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1040/2073] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:52.544928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47bba0-d814-4a93-b41f-fe4800445af7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.550893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.551616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.551904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.552187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.552930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:52.553240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.555037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.568469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1034/2074] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:52.573253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.585004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f7e44-3b0d-4615-9fb8-2684b99925bc service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.591314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.599807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.600316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.600703 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.601472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.603492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.634644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1041/2075] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:52 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:52.635813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.646461 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f9f6-7e4d-4ea9-80af-eb805f759bd0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.705254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.706277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.706696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.707046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.707840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.710169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.733235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1035/2076] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:52 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:52.737548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.748126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60b82a-b6e7-4e1b-9552-87a747ec77b5 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.752795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.753461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.753750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.754033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.754886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.756790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.769597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1042/2077] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:52.776469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.787583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7be3c3-a682-4fac-a08c-b6d100fabb95 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.793287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a9106-91c8-44a2-95d8-2d25f43e4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.793959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a9106-91c8-44a2-95d8-2d25f43e4240 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.794250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a9106-91c8-44a2-95d8-2d25f43e4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.794530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a9106-91c8-44a2-95d8-2d25f43e4240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.795325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a9106-91c8-44a2-95d8-2d25f43e4240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.796977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a9106-91c8-44a2-95d8-2d25f43e4240 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.810354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1036/2078] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:52.811992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.822965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269cae1-b238-484b-80f1-0a5728d9aea8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:52.828491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:52.829518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.829811 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.830089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] PATH_INFO: `/v3/projects/14730e5c83574ffc8f9c2d34551a697c/users/346742be39c047b2ac2507b34df21284/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.859349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14730e5c83574ffc8f9c2d34551a697c, user_id=346742be39c047b2ac2507b34df21284, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:52.862378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:52.879178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1043/2079] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:52 2022] PUT /identity/v3/projects/14730e5c83574ffc8f9c2d34551a697c/users/346742be39c047b2ac2507b34df21284/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:52.885659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769835-6846-4cf6-9726-6a812806a119 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:52.886248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769835-6846-4cf6-9726-6a812806a119 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:52.886599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769835-6846-4cf6-9726-6a812806a119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:52.914949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0e769835-6846-4cf6-9726-6a812806a119 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:52.916336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0e769835-6846-4cf6-9726-6a812806a119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:52.985973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1037/2080] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:52.995205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:52.997028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:53.061080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e8077-496c-415d-8db9-acbe48edbfd2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:53.064701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:53.065342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:53.065622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:53.065897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:53.076408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:53.077965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:53.089937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1044/2081] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:53.962536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:53.962999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:53.963171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.000477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] MFA Rules not processed for user `346742be39c047b2ac2507b34df21284`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:54.003286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:54.087777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1038/2082] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:54.093322 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.110491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311be49-23d4-4dbe-a8c8-3e47c9597002 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.116630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.117416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.117838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.118210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.118960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.121045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.152747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1045/2083] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:54 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:54.156320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.168310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a07f0-83a2-4eff-a84f-e2c84a0b7b1e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.244290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.246258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:54.256958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.258095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.258763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.259220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.260103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.262995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.294473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1039/2084] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:54 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:54.298442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.312195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626808-b1c6-4d0e-b55b-0ae14d8d1e54 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.318107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.318801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.319093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.319400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.320143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.321704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ae2d6-c953-46e3-8ffc-1281d192faf9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.321907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.330289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.331488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.332568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.333168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] PATH_INFO: `/v3/users/c7d8607b008940a4bd5f2eea1443bb7a` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.335925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d8607b008940a4bd5f2eea1443bb7a)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.338706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.346891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1040/2085] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:54.351442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.371478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befea67-4ba7-4641-bd53-e5ddb6787ba4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.375650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.377723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.377723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.378552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] PATH_INFO: `/v3/projects/1ea3e2b01e9a49de99fa624ef79ea201/users/49edbeffdbd842a5b1b603c44745a122/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.401463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea3e2b01e9a49de99fa624ef79ea201, user_id=49edbeffdbd842a5b1b603c44745a122, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.404931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.433059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1041/2086] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:54 2022] PUT /identity/v3/projects/1ea3e2b01e9a49de99fa624ef79ea201/users/49edbeffdbd842a5b1b603c44745a122/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:54.441844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.469382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d8607b008940a4bd5f2eea1443bb7a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:54.509785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d8607b008940a4bd5f2eea1443bb7a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:54.524222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d8607b008940a4bd5f2eea1443bb7a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:54.525519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d8607b008940a4bd5f2eea1443bb7a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:54.534521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-63ffe67e-4651-459b-94c3-22d0f65cebd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d8607b008940a4bd5f2eea1443bb7a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:54.544447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1046/2087] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:54 2022] DELETE /identity/v3/users/c7d8607b008940a4bd5f2eea1443bb7a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:54.550081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.550459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.550812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.558069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2c9c-fc47-4ccb-89cf-9ad00a109e62 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.570104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:54.571457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:54.624111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.624111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.624111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.624111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.624626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.625761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.674758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1042/2088] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:54.678697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.681242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:54.684657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1047/2089] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:54.705547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2af9d-8a16-4ed3-a907-f6f7270ecf16 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.706276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:54.708223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:54.711990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.713073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.713503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.713925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] PATH_INFO: `/v3/projects/1ea3e2b01e9a49de99fa624ef79ea201/users/49edbeffdbd842a5b1b603c44745a122/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.716811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea3e2b01e9a49de99fa624ef79ea201, user_id=49edbeffdbd842a5b1b603c44745a122, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.719755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.734203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1043/2090] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:54 2022] PUT /identity/v3/projects/1ea3e2b01e9a49de99fa624ef79ea201/users/49edbeffdbd842a5b1b603c44745a122/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:54.799980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfd1c3-3360-4c02-b23f-87531afd1051 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:54.869974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d44161-1df2-402f-a643-a0df7b87d2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:54.871404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d44161-1df2-402f-a643-a0df7b87d2dd service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:54.871687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d44161-1df2-402f-a643-a0df7b87d2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:54.872729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d44161-1df2-402f-a643-a0df7b87d2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:54.951675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d44161-1df2-402f-a643-a0df7b87d2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:54.953760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d44161-1df2-402f-a643-a0df7b87d2dd service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:54.966003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1048/2091] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:55.231298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:55.233651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:55.248129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882245c-5b88-4ccd-97b4-5aaec2d6bef3 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:55.256549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:55.257496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:55.257782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:55.258054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] PATH_INFO: `/v3/users/6b9a9606e343490a81380af231a5457e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:55.259901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9a9606e343490a81380af231a5457e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:55.277857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:55.389168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9a9606e343490a81380af231a5457e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.421019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9a9606e343490a81380af231a5457e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.434268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9a9606e343490a81380af231a5457e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.435221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9a9606e343490a81380af231a5457e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.437072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9a9606e343490a81380af231a5457e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.472204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1044/2092] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:55 2022] DELETE /identity/v3/users/6b9a9606e343490a81380af231a5457e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:55.476323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:55.477284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:55.477826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:55.502630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:55.504309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:55.614237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1049/2093] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:55.634773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:55.637983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:55.731384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:55.733787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:55.753278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68311eb-b90d-4f50-b6eb-bcc2ecbd593b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:55.775431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d90ff-02b2-4b88-952a-f1f0e1d639f0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:55.783577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861d6ea-de8a-4886-b5b9-5520b23910eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:55.785834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861d6ea-de8a-4886-b5b9-5520b23910eb service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:55.786430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861d6ea-de8a-4886-b5b9-5520b23910eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:55.788090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861d6ea-de8a-4886-b5b9-5520b23910eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:55.796894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:55.812870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861d6ea-de8a-4886-b5b9-5520b23910eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:55.814345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861d6ea-de8a-4886-b5b9-5520b23910eb service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:55.816296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:55.816593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:55.818754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] PATH_INFO: `/v3/projects/76f8f0262351489b9fff2553077ed957` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:55.821963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f8f0262351489b9fff2553077ed957)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:55.825938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:55.827474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1045/2094] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:55.908259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edbaf1-dcb4-4e5f-9eae-c8f89437b403 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:55.908560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edbaf1-dcb4-4e5f-9eae-c8f89437b403 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:55.908854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edbaf1-dcb4-4e5f-9eae-c8f89437b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:55.928716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f8f0262351489b9fff2553077ed957', 'request_id': 'req-9910553e-9090-4d76-9437-2f7d4d0ed108'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.939830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f8f0262351489b9fff2553077ed957', 'request_id': 'req-9910553e-9090-4d76-9437-2f7d4d0ed108'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.948085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f8f0262351489b9fff2553077ed957', 'request_id': 'req-9910553e-9090-4d76-9437-2f7d4d0ed108'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.962415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-58edbaf1-dcb4-4e5f-9eae-c8f89437b403 None None] MFA Rules not processed for user `49edbeffdbd842a5b1b603c44745a122`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:55.963701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-58edbaf1-dcb4-4e5f-9eae-c8f89437b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:55.969812 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] The token cache is being invalidate because project 76f8f0262351489b9fff2553077ed957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:55.970141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.970922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9910553e-9090-4d76-9437-2f7d4d0ed108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:55.978311 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1050/2095] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:55 2022] DELETE /identity/v3/projects/76f8f0262351489b9fff2553077ed957 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:55.979845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0398b2-7932-417f-9d27-c2ebfee7a753 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:55.980144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0398b2-7932-417f-9d27-c2ebfee7a753 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:55.980426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0398b2-7932-417f-9d27-c2ebfee7a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.020685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ca0398b2-7932-417f-9d27-c2ebfee7a753 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:56.032048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ca0398b2-7932-417f-9d27-c2ebfee7a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.134745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1046/2096] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:56.139645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1051/2097] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:56.154877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.157518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.158987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.165546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.167347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.169415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.208099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:56.209401 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.225863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] MFA Rules not processed for user `346742be39c047b2ac2507b34df21284`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:56.229400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.238639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1047/2098] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:56.244273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.304934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868bdcc-c199-4cfc-b5fe-bff465bca3b9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:56.320012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:56.321251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.322920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.324394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.325468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:56.326682 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:56.333981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:56.374939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1048/2099] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:56.376453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.429654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351071-b14c-482f-ac01-ba5fdd556d50 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:56.438399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:56.439434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.439976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.440397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.441448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:56.443663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:56.458750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1052/2100] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:56.469749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.472022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.489952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1049/2101] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:56 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:56.494629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.657315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b233-dcfb-4549-862d-bfe7682fcd5d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:56.661813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91127b0-61b2-49d1-a730-e8c4e06384ef None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:56.676481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:56.678011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.678606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.679229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.680809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:56.685860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:56.722353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1050/2102] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:56 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:56.726366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.728589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.753206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efef19-4c94-442a-a2e7-0f8db09192dd admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:56.761342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:56.762477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.762947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.763424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] PATH_INFO: `/v3/projects/13c5f0cdda4f47698be699d0210b5b1c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.765957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c5f0cdda4f47698be699d0210b5b1c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:56.769952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:56.778954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:56.780165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:56.780561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:56.781092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:56.788868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.859948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c5f0cdda4f47698be699d0210b5b1c', 'request_id': 'req-fed14677-f099-4838-a12a-54ed81feb3b3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:56.875649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c5f0cdda4f47698be699d0210b5b1c', 'request_id': 'req-fed14677-f099-4838-a12a-54ed81feb3b3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:56.892629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c5f0cdda4f47698be699d0210b5b1c', 'request_id': 'req-fed14677-f099-4838-a12a-54ed81feb3b3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:56.909580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] The token cache is being invalidate because project 13c5f0cdda4f47698be699d0210b5b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:56.910090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:56.911053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:56.912885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1051/2103] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:56 2022] DELETE /identity/v3/projects/13c5f0cdda4f47698be699d0210b5b1c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:56.913836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.915836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:56.918570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:56.920455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:56.934166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1053/2104] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:56.935305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:56.948676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5708ab-126f-4288-803a-4ad73f43c867 service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.021598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed14677-f099-4838-a12a-54ed81feb3b3 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.032912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.034376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.034695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.034936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.035744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:57.037480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:57.049030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.049919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.050206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.050483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] PATH_INFO: `/v3/users/0684558b259f4889956886552d41eba7` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.053314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0684558b259f4889956886552d41eba7)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:57.055307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:57.076567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1052/2105] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:57.077596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:57.099855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4effcd-8fbc-4f68-9011-ee304b7fa4ed admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.112180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.112877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.113167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.113452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.114197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:57.115863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:57.140405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1053/2106] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:57.142779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:57.173624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0684558b259f4889956886552d41eba7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.176846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ea7a-3afb-4e08-9c4f-f10458ecd85f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.185148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.186486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.186923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.187039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0684558b259f4889956886552d41eba7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.187480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] PATH_INFO: `/v3/projects/557ce377bcc14150ae855d02f8a0f97e/users/d5af1d85061e44d2a768f0ed379955c1/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.202914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0684558b259f4889956886552d41eba7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.207586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0684558b259f4889956886552d41eba7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.217426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8d3755ee-9f7c-46d6-bc30-862aa61b7bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0684558b259f4889956886552d41eba7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.222520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=557ce377bcc14150ae855d02f8a0f97e, user_id=d5af1d85061e44d2a768f0ed379955c1, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:57.224080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1054/2107] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:56 2022] DELETE /identity/v3/users/0684558b259f4889956886552d41eba7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:57.226962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:57.243202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1054/2108] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:57 2022] PUT /identity/v3/projects/557ce377bcc14150ae855d02f8a0f97e/users/d5af1d85061e44d2a768f0ed379955c1/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:57.257238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.257602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.257951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.299947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] MFA Rules not processed for user `d5af1d85061e44d2a768f0ed379955c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:57.301775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:57.434849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1055/2109] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:57.455418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:57.458730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:57.557672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9ad3-a7bf-4ef1-ae63-058a4688e7cc admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.561616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.562300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.562583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.562883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.575967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:57.577767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:57.588937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1055/2110] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:57.623492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:57.628254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:57.787936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef45dc-6db2-4fce-ac53-33427395e0d5 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.796102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.797465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.797905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.798354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] PATH_INFO: `/v3/users/d5af1d85061e44d2a768f0ed379955c1` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.801023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5af1d85061e44d2a768f0ed379955c1)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:57.803553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:57.903076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:57.905470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:57.966397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf9d97-2f8b-4195-a3e0-34f3b2b8c6a3 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:57.966845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5af1d85061e44d2a768f0ed379955c1'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.981254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:57.986027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5af1d85061e44d2a768f0ed379955c1'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:57.990264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:57.990885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:57.991211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] PATH_INFO: `/v3/projects/5fc59b64f09e42adb4786d06b4310802` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:57.998981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc59b64f09e42adb4786d06b4310802)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:58.001128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:58.013584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5af1d85061e44d2a768f0ed379955c1'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.014240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5af1d85061e44d2a768f0ed379955c1'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.024818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-40f64d6d-71a2-4eb6-b719-c538fc70b8f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5af1d85061e44d2a768f0ed379955c1'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.040735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1056/2111] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:43:57 2022] DELETE /identity/v3/users/d5af1d85061e44d2a768f0ed379955c1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:58.045903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.046378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.046664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.099966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:58.101546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.156277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc59b64f09e42adb4786d06b4310802', 'request_id': 'req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.176481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc59b64f09e42adb4786d06b4310802', 'request_id': 'req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.194508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc59b64f09e42adb4786d06b4310802', 'request_id': 'req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.227516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] The token cache is being invalidate because project 5fc59b64f09e42adb4786d06b4310802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:58.227857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.230878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-81e6bb49-b262-48af-b5d8-b9a6cf29bf9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:58.236016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1056/2112] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:57 2022] DELETE /identity/v3/projects/5fc59b64f09e42adb4786d06b4310802 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:58.243867 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac97ab-1429-4700-979f-e169ba7be824 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.256227 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac97ab-1429-4700-979f-e169ba7be824 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.256536 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1057/2113] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:43:58.257022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac97ab-1429-4700-979f-e169ba7be824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.263569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:58.269253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.317101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-65ac97ab-1429-4700-979f-e169ba7be824 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:58.318585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-65ac97ab-1429-4700-979f-e169ba7be824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.428713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24baab-e1f1-409e-8392-f04e02417e97 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:58.478208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1057/2114] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:58.487336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.487878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.488342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.504478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70199ccf-84e5-44d5-b01e-8ee83d1327f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:58.505223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70199ccf-84e5-44d5-b01e-8ee83d1327f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.505589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70199ccf-84e5-44d5-b01e-8ee83d1327f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.505909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70199ccf-84e5-44d5-b01e-8ee83d1327f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.519678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70199ccf-84e5-44d5-b01e-8ee83d1327f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:58.521221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70199ccf-84e5-44d5-b01e-8ee83d1327f5 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:58.533195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] MFA Rules not processed for user `fa3948f301e84488b6c3f0a6dc069202`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:58.534691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.547333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1058/2115] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:43:58.550307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.550759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.550930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.580484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:58.582010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.612831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1059/2116] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:58.618956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:58.644415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80819d-f859-497e-82fc-db5cccfe78ea None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:58.653622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:58.654305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.654781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.655232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.656179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:58.656772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:58.658831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53274-0d04-45c8-a30f-f051737d64c0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:58.678658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1058/2117] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:58.683359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1060/2118] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:58.685768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:58.691461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.692036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.692490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.699979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9f04-edfd-4534-bdc1-c93fda348bfd None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:58.706376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:58.707450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.707897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.708373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.709885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:58.712316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:58.739698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] MFA Rules not processed for user `fa3948f301e84488b6c3f0a6dc069202`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:58.742657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.755479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1059/2119] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:58.759532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:58.779699 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1061/2120] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:58.802766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:58.804251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:58.892032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9be0-d7c0-423f-bee3-ce46c721dfce admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:58.904862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:58.905723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.905852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.906115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.906829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:58.911466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:58.950296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03fca-27c8-484b-9393-0504031619b0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:58.962586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1060/2121] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:58 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:58.964667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:58.977184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402c447-7ee3-4613-908e-b9289698812d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:58.983997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:58.984686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:58.984976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:58.985256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:58.986001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:58.987995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.008841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1061/2122] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:59.015608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.029844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84d369-3013-42c9-b510-250711066491 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.039694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.041038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.041651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.042111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.043019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.045173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.068342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1062/2123] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:59.074347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.088652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3a06-9e03-41a8-bf93-2bd3614087d2 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.093868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1a84b-e5a9-4743-94fc-1e7097d0a062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.095616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.096139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1a84b-e5a9-4743-94fc-1e7097d0a062 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.097094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.097470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1a84b-e5a9-4743-94fc-1e7097d0a062 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.097817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1a84b-e5a9-4743-94fc-1e7097d0a062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.098768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.101831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] PATH_INFO: `/v3/projects/c730c33b9c3d48e4a55020a267e2f963/users/5590727e18a241519999c6e7e5b37db3/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.135177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c730c33b9c3d48e4a55020a267e2f963, user_id=5590727e18a241519999c6e7e5b37db3, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.139268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.161408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1063/2124] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:59 2022] PUT /identity/v3/projects/c730c33b9c3d48e4a55020a267e2f963/users/5590727e18a241519999c6e7e5b37db3/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:43:59.162084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.164008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:59.196435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1a84b-e5a9-4743-94fc-1e7097d0a062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.198188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1a84b-e5a9-4743-94fc-1e7097d0a062 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.208299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1062/2125] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:43:59.209791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.210148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.210550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.246905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3980-7d32-49a5-97df-66902d036e3d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.248750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] MFA Rules not processed for user `5590727e18a241519999c6e7e5b37db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:59.250414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:59.251468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.252406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.252758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.253109 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] PATH_INFO: `/v3/projects/557ce377bcc14150ae855d02f8a0f97e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.255930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557ce377bcc14150ae855d02f8a0f97e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.257849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.316665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557ce377bcc14150ae855d02f8a0f97e', 'request_id': 'req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:59.323144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1063/2126] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:59.326041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557ce377bcc14150ae855d02f8a0f97e', 'request_id': 'req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:59.326870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.332480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557ce377bcc14150ae855d02f8a0f97e', 'request_id': 'req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:59.338822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad2b45-2abb-45ab-a180-3d4fe44e9b8d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.344815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] The token cache is being invalidate because project 557ce377bcc14150ae855d02f8a0f97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:43:59.345110 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:59.345811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1f1b1675-dbe5-4450-bfc5-3a1bf385cae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:43:59.347442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1064/2127] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:43:59 2022] DELETE /identity/v3/projects/557ce377bcc14150ae855d02f8a0f97e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:59.352441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1234cb2-3c34-4906-83e0-ab7156318d60 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.352908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1234cb2-3c34-4906-83e0-ab7156318d60 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.353194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1234cb2-3c34-4906-83e0-ab7156318d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.382599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b1234cb2-3c34-4906-83e0-ab7156318d60 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:59.383847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b1234cb2-3c34-4906-83e0-ab7156318d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:59.448128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.449425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.449845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.450126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.450874 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.453056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.460120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1065/2128] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:59.470060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.470306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.471077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.487150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1064/2129] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:59.491219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.492400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:59.493108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:59.493967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:43:59.578592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f18e46-f320-43d4-b25f-754a482119b7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.587904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.588702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.589452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.589774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.590749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.594519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.601246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1066/2130] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:43:59.605947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.623021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d0b2c-e856-4ce1-8e04-857bd4f2f2f5 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.629687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.630721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.631046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.632254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.633030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:43:59.633440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.635784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.637708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1065/2131] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:43:59.639163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.657497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b227e-e758-44c7-ae76-bdbcf1f230ac admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.663387 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.664198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.664579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.664954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.665792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.667567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.678825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1067/2132] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:43:59.680718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1066/2133] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:59.684556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.685697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.699538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c517-7e5a-466c-9be5-ccb16da03b2d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.704170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def5c1b-ff13-4b9f-bf3f-5c86a01474e1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.709409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.711517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.711947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.712327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.713206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.715773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.716975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.718477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.718641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.718879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.719639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.727724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.741711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1067/2134] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:43:59.742705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.759928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09488605-68d2-4d5c-b811-3580dcac36d1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.774665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39926694-e73c-4642-b935-45637fcb904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:43:59.775005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1068/2135] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:43:59.776774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926694-e73c-4642-b935-45637fcb904a admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.777057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926694-e73c-4642-b935-45637fcb904a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.777333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926694-e73c-4642-b935-45637fcb904a admin admin] PATH_INFO: `/v3/projects/635e709b9b524101997393f2b8846791/users/c59930a6c1f14d92b763d5cc73725a7c/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.780385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:43:59.812942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39926694-e73c-4642-b935-45637fcb904a admin admin] RBAC: Authorizing `identity:create_grant(project_id=635e709b9b524101997393f2b8846791, user_id=c59930a6c1f14d92b763d5cc73725a7c, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:43:59.824028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39926694-e73c-4642-b935-45637fcb904a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:43:59.862297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1068/2136] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:43:59 2022] PUT /identity/v3/projects/635e709b9b524101997393f2b8846791/users/c59930a6c1f14d92b763d5cc73725a7c/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:43:59.865035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:43:59.865336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:43:59.866011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:43:59.880374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1131ff-7721-4b60-8f21-5ae9e574ae86 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:43:59.924855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] MFA Rules not processed for user `c59930a6c1f14d92b763d5cc73725a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:43:59.926081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:00.043504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1069/2137] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:00.044514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.087833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.102089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.104242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.106145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.112825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.115100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.157446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1069/2138] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:43:59 2022] POST /identity/v3/users => generated 288 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:00.162545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.179531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911eff6-09e7-4cda-a12e-7801b605924d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.181978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a1c8-baac-4c0e-8fcd-5bea8f746349 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.188295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.189866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.190366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.190877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.192292 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.194458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.207005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1070/2139] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:00.213725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.215987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.219971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.220358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.223849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.225064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.227039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.237012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6770-a6dc-4608-b608-61bab12e9f45 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.249696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.252807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.253105 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.253448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.254270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.260352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.282739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1070/2140] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:00 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:00.286683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1071/2141] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:00.286821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.288249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.325917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f4f6-ae90-4398-9616-536147994693 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.402468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc6d17-889b-403a-933d-5ac99de8a9a9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.408493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.409576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.409964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.410351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] PATH_INFO: `/v3/projects/cba02e43a4f64e8792f0b78cd68514eb/users/ce9e4900147944a39ddce372eccb15d6/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.420625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e2f38-f1b3-4e04-87f2-fb249fdec2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.421340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2f38-f1b3-4e04-87f2-fb249fdec2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.421626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2f38-f1b3-4e04-87f2-fb249fdec2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.421905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2f38-f1b3-4e04-87f2-fb249fdec2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.422604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e2f38-f1b3-4e04-87f2-fb249fdec2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.426177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e2f38-f1b3-4e04-87f2-fb249fdec2f8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.447601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba02e43a4f64e8792f0b78cd68514eb, user_id=ce9e4900147944a39ddce372eccb15d6, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.450966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.470322 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1071/2142] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:00 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:00.473813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d6fe-d41f-4145-8775-bbd1cb0e87fd None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.474111 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d6fe-d41f-4145-8775-bbd1cb0e87fd None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.474393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976d6fe-d41f-4145-8775-bbd1cb0e87fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.477011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1072/2143] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:00 2022] PUT /identity/v3/projects/cba02e43a4f64e8792f0b78cd68514eb/users/ce9e4900147944a39ddce372eccb15d6/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:00.478159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.514802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f976d6fe-d41f-4145-8775-bbd1cb0e87fd None None] MFA Rules not processed for user `fa3948f301e84488b6c3f0a6dc069202`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:00.516297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f976d6fe-d41f-4145-8775-bbd1cb0e87fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:00.583844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1072/2144] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:00.583844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.583844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.583844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.604800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459709ee-9917-465c-9bc7-bd851796ba4e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.611912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.612672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.612964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.613247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.613999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.615691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.642488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] MFA Rules not processed for user `ce9e4900147944a39ddce372eccb15d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:00.644403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:00.667813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1073/2145] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:00.672600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.716804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709f642-eb1c-475b-9390-299d12832add admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.737456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.740550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.742309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.743406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] PATH_INFO: `/v3/projects/70c7a8bf43364a6eb1928979abefeae1/users/3be4053225e749ddb65dfdba78b1658a/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.750366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1073/2146] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:00.763749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.765230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:00.780499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c7a8bf43364a6eb1928979abefeae1, user_id=3be4053225e749ddb65dfdba78b1658a, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.786125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.806409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1074/2147] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:00 2022] PUT /identity/v3/projects/70c7a8bf43364a6eb1928979abefeae1/users/3be4053225e749ddb65dfdba78b1658a/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:00.812180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.853107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec43b-7a7e-44c0-a14c-b62d2c4cbba7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.926541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793e0f-5b2d-4338-9051-7f20ebe45281 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.941087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.941799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.942095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.943210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.944093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:00.947904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:00.972710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1075/2148] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:00.972710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:00.980581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:00.981436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:00.981735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:00.982246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:00.987083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8cc09-6b23-4da0-97b1-eb838d6f12bd admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:00.999194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2ccd-4fdc-49e4-83b0-7fec327a803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:01.000722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2ccd-4fdc-49e4-83b0-7fec327a803d admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:01.001038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2ccd-4fdc-49e4-83b0-7fec327a803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:01.001384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2ccd-4fdc-49e4-83b0-7fec327a803d admin admin] PATH_INFO: `/v3/projects/70c7a8bf43364a6eb1928979abefeae1/users/3be4053225e749ddb65dfdba78b1658a/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:01.007000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2ccd-4fdc-49e4-83b0-7fec327a803d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c7a8bf43364a6eb1928979abefeae1, user_id=3be4053225e749ddb65dfdba78b1658a, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:01.012736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2ccd-4fdc-49e4-83b0-7fec327a803d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:01.025467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1076/2149] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:00 2022] PUT /identity/v3/projects/70c7a8bf43364a6eb1928979abefeae1/users/3be4053225e749ddb65dfdba78b1658a/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:01.037054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820139e-5fab-45d5-8683-419583f2201b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:01.037464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820139e-5fab-45d5-8683-419583f2201b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:01.037851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820139e-5fab-45d5-8683-419583f2201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:01.070835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6820139e-5fab-45d5-8683-419583f2201b None None] MFA Rules not processed for user `3be4053225e749ddb65dfdba78b1658a`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:01.072500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6820139e-5fab-45d5-8683-419583f2201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:01.120563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:01.122246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:01.135277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1074/2150] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:01.209035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1077/2151] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:01.270793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:01.275918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:01.297930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10dbf-58a1-48ff-9435-1a1c3235fc21 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:01.380001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a272f0-44b9-4193-968f-cb75ce9b7da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:01.380754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a272f0-44b9-4193-968f-cb75ce9b7da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:01.381070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a272f0-44b9-4193-968f-cb75ce9b7da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:01.381402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a272f0-44b9-4193-968f-cb75ce9b7da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:01.398494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a272f0-44b9-4193-968f-cb75ce9b7da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:01.400198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a272f0-44b9-4193-968f-cb75ce9b7da8 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:01.413302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1075/2152] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:01.489810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820139e-5fab-45d5-8683-419583f2201b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:01.507654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820139e-5fab-45d5-8683-419583f2201b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:01.533366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:01.534045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:01.534329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:01.534603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:01.544962 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:01.753898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:01.759465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:01.785854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1078/2153] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:02.752655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c4c64-f683-4aa6-a459-43068eecdbcc None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:02.754112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c4c64-f683-4aa6-a459-43068eecdbcc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:02.754624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c4c64-f683-4aa6-a459-43068eecdbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:02.785937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-164c4c64-f683-4aa6-a459-43068eecdbcc None None] MFA Rules not processed for user `ce9e4900147944a39ddce372eccb15d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:02.787467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-164c4c64-f683-4aa6-a459-43068eecdbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:02.872963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1076/2154] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:05.480520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:05.541159 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1badd-2bbd-43df-a745-082972cef98c service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:05.546335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:05.547235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:05.547524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:05.547801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] PATH_INFO: `/v3/users/5590727e18a241519999c6e7e5b37db3` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:05.549012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5590727e18a241519999c6e7e5b37db3)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:05.550926 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:05.594912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5590727e18a241519999c6e7e5b37db3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:05.606974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5590727e18a241519999c6e7e5b37db3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:05.614245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5590727e18a241519999c6e7e5b37db3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:05.614866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5590727e18a241519999c6e7e5b37db3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:05.615481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5590727e18a241519999c6e7e5b37db3'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:05.627309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1079/2155] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:05 2022] DELETE /identity/v3/users/5590727e18a241519999c6e7e5b37db3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:05.631852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:05.632320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:05.632411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:05.650359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:05.652059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:05.710344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1077/2156] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:05.720690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:05.722028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:05.777519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073eadf-bb43-4bac-8b3b-b1660559beeb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:05.781143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:05.781790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:05.782074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:05.782352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:05.791176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:05.792608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:05.801698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1080/2157] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:06.062907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:06.064677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:06.079396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbbc6-b54e-4f05-92aa-007a114bb4f6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:06.084075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:06.086053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:06.086419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:06.086595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] PATH_INFO: `/v3/projects/c730c33b9c3d48e4a55020a267e2f963` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:06.088459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c730c33b9c3d48e4a55020a267e2f963)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:06.090548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:06.136878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c730c33b9c3d48e4a55020a267e2f963', 'request_id': 'req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.143813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c730c33b9c3d48e4a55020a267e2f963', 'request_id': 'req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.149232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c730c33b9c3d48e4a55020a267e2f963', 'request_id': 'req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.159953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] The token cache is being invalidate because project c730c33b9c3d48e4a55020a267e2f963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:06.160239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.160887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.162632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1078/2158] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:06 2022] DELETE /identity/v3/projects/c730c33b9c3d48e4a55020a267e2f963 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:06.166305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:06.175719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047871de-cfbe-4261-899a-2821732d1dc4 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:06.231974 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:06.232784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:06.233067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:06.233361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] PATH_INFO: `/v3/users/c59930a6c1f14d92b763d5cc73725a7c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:06.234683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59930a6c1f14d92b763d5cc73725a7c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:06.236655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:06.280748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59930a6c1f14d92b763d5cc73725a7c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.291895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59930a6c1f14d92b763d5cc73725a7c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.299336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59930a6c1f14d92b763d5cc73725a7c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.300062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59930a6c1f14d92b763d5cc73725a7c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.300701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59930a6c1f14d92b763d5cc73725a7c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.313326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1081/2159] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:06 2022] DELETE /identity/v3/users/c59930a6c1f14d92b763d5cc73725a7c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:06.591538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:06.591538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:06.602475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb5ef4-9fd8-46d0-9b20-e9cc0a05a73e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:06.659392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:06.660243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:06.660522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:06.660794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] PATH_INFO: `/v3/projects/635e709b9b524101997393f2b8846791` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:06.661949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635e709b9b524101997393f2b8846791)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:06.663906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:06.707936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635e709b9b524101997393f2b8846791', 'request_id': 'req-8c99ff0c-56ac-44f9-abdf-7957908edbc3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.716288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635e709b9b524101997393f2b8846791', 'request_id': 'req-8c99ff0c-56ac-44f9-abdf-7957908edbc3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.722126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635e709b9b524101997393f2b8846791', 'request_id': 'req-8c99ff0c-56ac-44f9-abdf-7957908edbc3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.733166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] The token cache is being invalidate because project 635e709b9b524101997393f2b8846791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:06.733457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.734120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.735688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1079/2160] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:06 2022] DELETE /identity/v3/projects/635e709b9b524101997393f2b8846791 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:06.739624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:06.741021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:06.754095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0cf06-d483-479d-bcbf-3345a1dfe505 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:06.808858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:06.809666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:06.809955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:06.810232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] PATH_INFO: `/v3/users/3be4053225e749ddb65dfdba78b1658a` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:06.811478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be4053225e749ddb65dfdba78b1658a)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:06.813395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:06.857213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be4053225e749ddb65dfdba78b1658a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.868536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be4053225e749ddb65dfdba78b1658a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.875564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be4053225e749ddb65dfdba78b1658a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.876177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be4053225e749ddb65dfdba78b1658a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.876783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41d4efd8-39d3-415e-b484-5e153b861ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be4053225e749ddb65dfdba78b1658a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:06.888630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1082/2161] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:06 2022] DELETE /identity/v3/users/3be4053225e749ddb65dfdba78b1658a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:07.147212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.148959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:07.163177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99ff0c-56ac-44f9-abdf-7957908edbc3 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.219781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.220640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.220919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.221190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] PATH_INFO: `/v3/projects/70c7a8bf43364a6eb1928979abefeae1` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.222348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c7a8bf43364a6eb1928979abefeae1)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.224287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.268718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c7a8bf43364a6eb1928979abefeae1', 'request_id': 'req-66cc5543-0398-4ac9-ba1b-8af36c7a160e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:07.275924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c7a8bf43364a6eb1928979abefeae1', 'request_id': 'req-66cc5543-0398-4ac9-ba1b-8af36c7a160e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:07.281980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c7a8bf43364a6eb1928979abefeae1', 'request_id': 'req-66cc5543-0398-4ac9-ba1b-8af36c7a160e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:07.292564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] The token cache is being invalidate because project 70c7a8bf43364a6eb1928979abefeae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:07.292847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:07.293479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-66cc5543-0398-4ac9-ba1b-8af36c7a160e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:07.295005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1080/2162] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:07 2022] DELETE /identity/v3/projects/70c7a8bf43364a6eb1928979abefeae1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:07.301143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.301465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.301751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.320089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:07.321506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:07.377774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1083/2163] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:07.386751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.387070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.387376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.406691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:07.408521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:07.418597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1081/2164] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:07.422849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.432589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4c04d-e697-4db4-86ad-dfef2573f9df None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.437216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.437891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.438176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.438458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.439221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:44:07.439538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.441144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.453581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1084/2165] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:44:07.458115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.470330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183319f-ca4a-4828-81a9-b87eca0f395f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.475180 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.475847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.476130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.476408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.477108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.479078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.506407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1082/2166] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:07 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:07.510587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.521643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd52db-2bda-4712-8224-22527f1fab43 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.580451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.581048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.581334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.581619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.582310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.584273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.622436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1085/2167] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:07 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:07.626407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.646181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08416-ee5f-43e0-a399-ea3147b18709 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.659768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.661211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.661539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.661969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.662721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.664500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.676090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1083/2168] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:07.680034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.691792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578d66-d330-42fa-a1ac-bb5441ab0e10 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.696769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343eb3d-dfc3-4b03-a843-b7c2a6113fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.697457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343eb3d-dfc3-4b03-a843-b7c2a6113fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.699277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343eb3d-dfc3-4b03-a843-b7c2a6113fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.699574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343eb3d-dfc3-4b03-a843-b7c2a6113fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.700333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343eb3d-dfc3-4b03-a843-b7c2a6113fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.702313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343eb3d-dfc3-4b03-a843-b7c2a6113fd4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.721448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1086/2169] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:44:07.725799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.735784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d28b2c-8935-46e1-834d-d77c53c63e2f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:07.740383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:07.741271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.741552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.741823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] PATH_INFO: `/v3/projects/aa8ea2a0fb104aa1ae41dac99baa7c6a/users/5f99b53d0b46465989f9e1e6fb78b862/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.757905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ea2a0fb104aa1ae41dac99baa7c6a, user_id=5f99b53d0b46465989f9e1e6fb78b862, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:07.760743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:07.776440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1084/2170] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:07 2022] PUT /identity/v3/projects/aa8ea2a0fb104aa1ae41dac99baa7c6a/users/5f99b53d0b46465989f9e1e6fb78b862/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:07.792144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:07.792706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:07.792706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:07.819705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] MFA Rules not processed for user `5f99b53d0b46465989f9e1e6fb78b862`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:07.821089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:07.901348 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1087/2171] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:07.924776 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:07.927025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:08.026780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9bdab-87f6-41ff-b499-725d5bc448ed admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:08.037172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bc230-4f6d-4ee6-bb08-8b7058c5abef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:08.037848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc230-4f6d-4ee6-bb08-8b7058c5abef service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:08.038134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc230-4f6d-4ee6-bb08-8b7058c5abef service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:08.038412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc230-4f6d-4ee6-bb08-8b7058c5abef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:08.048462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bc230-4f6d-4ee6-bb08-8b7058c5abef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:08.050066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bc230-4f6d-4ee6-bb08-8b7058c5abef service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:08.060563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1085/2172] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:44:12.185545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:12.244340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288fbef-a872-42cd-98a9-28f096bfdb19 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:12.249394 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:12.250267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:12.250576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:12.250854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] PATH_INFO: `/v3/users/5f99b53d0b46465989f9e1e6fb78b862` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:12.252078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f99b53d0b46465989f9e1e6fb78b862)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:12.254005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:12.298731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f99b53d0b46465989f9e1e6fb78b862'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:12.310418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f99b53d0b46465989f9e1e6fb78b862'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:12.316942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f99b53d0b46465989f9e1e6fb78b862'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:12.317559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f99b53d0b46465989f9e1e6fb78b862'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:12.318167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f99b53d0b46465989f9e1e6fb78b862'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:12.330667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1088/2173] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:12 2022] DELETE /identity/v3/users/5f99b53d0b46465989f9e1e6fb78b862 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:12.335169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:12.335621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:12.335740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:12.355688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:12.356953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:12.414062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1086/2174] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:12.427588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:12.428999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:12.510933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab8f48-e1ab-4fc6-be40-ae1155a0621c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:12.514692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957c76c-f567-4f84-b074-c85bd0f1b28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:12.515552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c76c-f567-4f84-b074-c85bd0f1b28c service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:12.515840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c76c-f567-4f84-b074-c85bd0f1b28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:12.516371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c76c-f567-4f84-b074-c85bd0f1b28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:12.526088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957c76c-f567-4f84-b074-c85bd0f1b28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:12.527635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957c76c-f567-4f84-b074-c85bd0f1b28c service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:12.537206 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1089/2175] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:13.021548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.023040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:13.047013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67780de0-a494-4def-b3ee-faa11498b20d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.051849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.052712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.052992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.053266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] PATH_INFO: `/v3/projects/aa8ea2a0fb104aa1ae41dac99baa7c6a` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.055252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8ea2a0fb104aa1ae41dac99baa7c6a)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.056469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.108588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8ea2a0fb104aa1ae41dac99baa7c6a', 'request_id': 'req-43224e33-ae43-41f3-86bc-7e7ef152b7b9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:13.117175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8ea2a0fb104aa1ae41dac99baa7c6a', 'request_id': 'req-43224e33-ae43-41f3-86bc-7e7ef152b7b9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:13.122723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8ea2a0fb104aa1ae41dac99baa7c6a', 'request_id': 'req-43224e33-ae43-41f3-86bc-7e7ef152b7b9'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:13.134153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] The token cache is being invalidate because project aa8ea2a0fb104aa1ae41dac99baa7c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:13.134439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:13.135096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-43224e33-ae43-41f3-86bc-7e7ef152b7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:13.137057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1087/2176] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:13 2022] DELETE /identity/v3/projects/aa8ea2a0fb104aa1ae41dac99baa7c6a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:13.142371 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.142664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.142954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.162258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:13.163589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:13.227175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1090/2177] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:13.234853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.235174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.235462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.253934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:13.255158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:13.263681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1088/2178] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:13.268120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.278774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032269a-b312-4562-8e6b-575306b6e88d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.283468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.284203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.284500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.284775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.285512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:44:13.285843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.287497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.298777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1091/2179] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:44:13.303267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.312832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653edf01-9eb5-49ca-bd61-ee9df4474fbd None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.318634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.319396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.319706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.320007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.320993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.323971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.353828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1089/2180] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:13.355145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.370163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0c6b1-6e7f-4c2d-bc2c-5ba7d825d5b2 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.438196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.438968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.439354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.439694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.440719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.443038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.468815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1092/2181] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:13.473355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.483327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc492ece-f2e1-4967-8afe-be59d3ca5adf admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.488212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.488995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.489338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.489678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.490461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.492306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.503173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1090/2182] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:13.507269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.518629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda632a-a83f-4e84-b152-a7d432036916 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.531505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1ab09-dc9e-4d1f-a4a9-375c9e5555c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.532524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1ab09-dc9e-4d1f-a4a9-375c9e5555c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.532911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1ab09-dc9e-4d1f-a4a9-375c9e5555c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.533253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1ab09-dc9e-4d1f-a4a9-375c9e5555c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.534411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1ab09-dc9e-4d1f-a4a9-375c9e5555c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.535808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1ab09-dc9e-4d1f-a4a9-375c9e5555c8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.547677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1093/2183] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:13.551898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.563887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb980e7-93aa-4dbd-8229-2d03337e7ef1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.569961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.571095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.571567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.572058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] PATH_INFO: `/v3/projects/8c36c7e103fd4a81b51cf9cd5b8beebf/users/a58ce30aa9f342f09a076e3f98e9d4f4/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.602613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c36c7e103fd4a81b51cf9cd5b8beebf, user_id=a58ce30aa9f342f09a076e3f98e9d4f4, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.607207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.661325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1091/2184] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:13 2022] PUT /identity/v3/projects/8c36c7e103fd4a81b51cf9cd5b8beebf/users/a58ce30aa9f342f09a076e3f98e9d4f4/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:13.673003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.673365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.673699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.728322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] MFA Rules not processed for user `a58ce30aa9f342f09a076e3f98e9d4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:13.729896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:13.862830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1094/2185] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:13.867836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.947046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b90e-6397-4e81-ab2d-349ba4ad2e82 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:13.952592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:13.953253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:13.953542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:13.953819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:13.954537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:13.956521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:13.984692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1092/2186] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:13.985839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:13.996870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3399d7d-5535-4e3a-a818-1e1ed7589275 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.055125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.055817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.056106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.056424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.057141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.059791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.083492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1095/2187] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:13 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:14.084800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.096100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb5f0e-cd29-4e39-9676-75d7781c7e55 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.105062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.106324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.106600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.106989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.107883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.110739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.124357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1093/2188] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:44:14.128323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.138975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00ece-0e1a-439e-b346-2f53249b9652 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.145274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e163116-3239-4b8c-9529-4c515eade5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.146261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e163116-3239-4b8c-9529-4c515eade5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.146503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e163116-3239-4b8c-9529-4c515eade5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.147205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e163116-3239-4b8c-9529-4c515eade5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.147918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e163116-3239-4b8c-9529-4c515eade5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.149903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e163116-3239-4b8c-9529-4c515eade5ea admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.165561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1096/2189] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:14.167876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.185170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4934c-39c6-4dbd-ac30-705716d80866 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.190244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.191360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.191647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.191923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] PATH_INFO: `/v3/projects/7b6e889e24e4402a8a0e86343234c8ee/users/9a1672fc4f924d818c8557cea3868a62/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.210467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6e889e24e4402a8a0e86343234c8ee, user_id=9a1672fc4f924d818c8557cea3868a62, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.213613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.235665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1094/2190] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:14 2022] PUT /identity/v3/projects/7b6e889e24e4402a8a0e86343234c8ee/users/9a1672fc4f924d818c8557cea3868a62/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:14.313664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.314168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.314491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.344377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] MFA Rules not processed for user `9a1672fc4f924d818c8557cea3868a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:14.345701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:14.467477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1097/2191] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:14.482443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.570599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6489f-48f5-4767-a65a-2b4bcfc3f6c0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.578001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.578656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.578996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.580015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.580739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.582697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.620884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1095/2192] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:14 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:14.622115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.635398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf358ae-fcdc-4888-96af-500656fb161a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.694369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.695049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.695364 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.695644 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.696334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.698767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.718183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1098/2193] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:14 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:14.722314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.732887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cffc3-559d-49a3-b9cb-264c46e45ee1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.737528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.738184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.738472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.738753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.739520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.741119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.751394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1096/2194] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:14.755479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.766533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db180-e763-48ab-babc-32ed39549b8b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.771564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.772579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.772949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.773275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] PATH_INFO: `/v3/projects/affdc559141f4557b88cab4a1134c37f/users/e962dcc40a354acabfa90f08a625f545/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.788807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=affdc559141f4557b88cab4a1134c37f, user_id=e962dcc40a354acabfa90f08a625f545, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.791759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.804403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1099/2195] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:14 2022] PUT /identity/v3/projects/affdc559141f4557b88cab4a1134c37f/users/e962dcc40a354acabfa90f08a625f545/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:14.808521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.818377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01f23-06e8-435b-aea6-7c1fbf07e411 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.876340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960f40-584c-4f50-a0cf-7849d98dbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.877254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960f40-584c-4f50-a0cf-7849d98dbe0b admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.877547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960f40-584c-4f50-a0cf-7849d98dbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.877828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960f40-584c-4f50-a0cf-7849d98dbe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.878555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d960f40-584c-4f50-a0cf-7849d98dbe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.880187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d960f40-584c-4f50-a0cf-7849d98dbe0b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.890618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1097/2196] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:44:14.894706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:14.905403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563f74-2a59-43b2-baf3-0f0e474037ff admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:14.910429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:14.911349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.911633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.911917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] PATH_INFO: `/v3/projects/affdc559141f4557b88cab4a1134c37f/users/e962dcc40a354acabfa90f08a625f545/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.913923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affdc559141f4557b88cab4a1134c37f, user_id=e962dcc40a354acabfa90f08a625f545, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:14.916730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:14.929981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1100/2197] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:14 2022] PUT /identity/v3/projects/affdc559141f4557b88cab4a1134c37f/users/e962dcc40a354acabfa90f08a625f545/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:14.941282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:14.941583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:14.941867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:14.973799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] MFA Rules not processed for user `e962dcc40a354acabfa90f08a625f545`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:14.975143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:15.048914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1098/2198] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:15.060619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:15.062361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:15.118169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57947b8-1b03-49d0-9292-d894a0ade181 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:15.122323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:15.122968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:15.123291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:15.123570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:15.180078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:15.181433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:15.190770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1101/2199] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:16.657582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:16.667073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce148e-b78a-447a-a5f9-0a3ef96f3031 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:16.670646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:16.671312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:16.671598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:16.671881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:16.726780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:16.728172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:16.737094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1099/2200] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:17.384150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:17.392803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d703d-41e2-4ed4-a637-ae1bcac7db20 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:17.396470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d5617-25dd-4b4c-a26a-7f44d2c3dd41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:17.397108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5617-25dd-4b4c-a26a-7f44d2c3dd41 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:17.397391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5617-25dd-4b4c-a26a-7f44d2c3dd41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:17.397670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5617-25dd-4b4c-a26a-7f44d2c3dd41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:17.407177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d5617-25dd-4b4c-a26a-7f44d2c3dd41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:17.408592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d5617-25dd-4b4c-a26a-7f44d2c3dd41 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:17.418705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1102/2201] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:18.019573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:18.020698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:18.085151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a954-8735-4185-93e6-7d5f51475343 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:18.089694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:18.090552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:18.090837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:18.091135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] PATH_INFO: `/v3/users/ed9388777ac4481fbbc50490c1bf24f7` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:18.092321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9388777ac4481fbbc50490c1bf24f7)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:18.094258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:18.138251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9388777ac4481fbbc50490c1bf24f7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.149528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9388777ac4481fbbc50490c1bf24f7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.156499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9388777ac4481fbbc50490c1bf24f7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.157149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9388777ac4481fbbc50490c1bf24f7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.163661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9388777ac4481fbbc50490c1bf24f7'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.169419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1100/2202] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:18 2022] DELETE /identity/v3/users/ed9388777ac4481fbbc50490c1bf24f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:18.174305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:18.174600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:18.174883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:18.191875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:18.193069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:18.249272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1103/2203] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:18.258606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:18.260009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:18.314101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ae374-577f-4ad6-ba1a-c87e54c529a6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:18.317676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310e63-365c-4aaf-b277-09d1c9ca76b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:18.318317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310e63-365c-4aaf-b277-09d1c9ca76b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:18.318600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310e63-365c-4aaf-b277-09d1c9ca76b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:18.318877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310e63-365c-4aaf-b277-09d1c9ca76b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:18.328432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310e63-365c-4aaf-b277-09d1c9ca76b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:18.329899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310e63-365c-4aaf-b277-09d1c9ca76b4 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:18.339124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1101/2204] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:18.747143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:18.749316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:18.762155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159391f-1b51-4bc4-846f-3fdf01d15235 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:18.767536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:18.768672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:18.770228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:18.770824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] PATH_INFO: `/v3/projects/7d4ce69ae44f4a7db9f18fa4e8257924` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:18.772859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4ce69ae44f4a7db9f18fa4e8257924)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:18.775295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:18.831670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4ce69ae44f4a7db9f18fa4e8257924', 'request_id': 'req-d60bde59-4409-4c13-8ee1-22b79ffbc700'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.840427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4ce69ae44f4a7db9f18fa4e8257924', 'request_id': 'req-d60bde59-4409-4c13-8ee1-22b79ffbc700'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.846450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4ce69ae44f4a7db9f18fa4e8257924', 'request_id': 'req-d60bde59-4409-4c13-8ee1-22b79ffbc700'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.858076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] The token cache is being invalidate because project 7d4ce69ae44f4a7db9f18fa4e8257924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:18.858377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.859038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d60bde59-4409-4c13-8ee1-22b79ffbc700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:18.860629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1104/2205] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:18 2022] DELETE /identity/v3/projects/7d4ce69ae44f4a7db9f18fa4e8257924 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:18.865355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:18.865639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:18.865913 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:18.884051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:18.885300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:18.943691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1102/2206] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:18.951598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:18.951896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:18.952183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:18.970750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:18.972046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:18.980648 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1105/2207] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:18.984753 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:18.994377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c8041-def9-4b3c-9da4-95a58c3e1bea None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:18.999153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.000019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.000388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.000676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.001553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:44:19.001927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.004109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.019762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1103/2208] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:44:19.020886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:19.030702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48cf2-0fa6-4184-b3ce-0708579bfa7b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:19.035375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.036035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.036322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.036595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.037300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.039232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.064803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1106/2209] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:19 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:19.069457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:19.079728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d484-095c-471c-b83f-6f27960d6206 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:19.136711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.137395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.137810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.138093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.138785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.140783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.160725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1104/2210] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:19 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:19.164819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:19.175727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8e3b-84ee-4545-ae17-cc3246e1a060 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:19.180325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.180986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.181275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.181557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.182309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.183958 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.194205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1107/2211] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:19.197670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:19.207859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9b10c-ed5a-4ee8-aae5-8e716f434149 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:19.212500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29518bc-ed84-418c-9aae-27486d741be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.213151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29518bc-ed84-418c-9aae-27486d741be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.213439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29518bc-ed84-418c-9aae-27486d741be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.214354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29518bc-ed84-418c-9aae-27486d741be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.215076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29518bc-ed84-418c-9aae-27486d741be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.216694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29518bc-ed84-418c-9aae-27486d741be6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.226295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1105/2212] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:44:19.230252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:19.239973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416690e-6cc9-482c-876d-1fc73619526e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:19.244550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.245428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.245712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.245990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] PATH_INFO: `/v3/projects/9d8b5a05a9574529933257869bccbe11/users/708bb893b531410399fda432edbbae6b/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.260961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8b5a05a9574529933257869bccbe11, user_id=708bb893b531410399fda432edbbae6b, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.263704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.277556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1108/2213] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:19 2022] PUT /identity/v3/projects/9d8b5a05a9574529933257869bccbe11/users/708bb893b531410399fda432edbbae6b/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:19.287670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.287968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.288250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.313731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] MFA Rules not processed for user `708bb893b531410399fda432edbbae6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:19.314935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:19.375585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1106/2214] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:19.387066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:19.388796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:19.445699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51850-5feb-4673-9143-79d0d7a62245 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:19.449967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:19.450618 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:19.450907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:19.451212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:19.460189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:19.462046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:19.473326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1109/2215] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:21.394326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:21.395820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:21.478774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d55a95-467f-40a9-ba14-7cb68367ebf8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:21.484431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:21.485670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:21.485953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:21.486403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] PATH_INFO: `/v3/users/a58ce30aa9f342f09a076e3f98e9d4f4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:21.487652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58ce30aa9f342f09a076e3f98e9d4f4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:21.489591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:21.539584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:21.549381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24ded0-09b8-4a54-b2c5-b9e779cfc45a service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:21.549727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58ce30aa9f342f09a076e3f98e9d4f4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:21.553809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:21.554457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:21.554740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:21.555218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:21.557042 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:21.562794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58ce30aa9f342f09a076e3f98e9d4f4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:21.572060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58ce30aa9f342f09a076e3f98e9d4f4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:21.572775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58ce30aa9f342f09a076e3f98e9d4f4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:21.581057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d8b59974-47c9-49e0-a3eb-b18190ae578b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58ce30aa9f342f09a076e3f98e9d4f4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:21.587538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1107/2216] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:21 2022] DELETE /identity/v3/users/a58ce30aa9f342f09a076e3f98e9d4f4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:21.592197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:21.592544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:21.592830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:21.612518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:21.613722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:21.631085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:21.632578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:21.642742 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1110/2217] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:21.671829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1108/2218] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:21.681948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:21.684080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:21.740347 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6da4-da2f-4bdd-a8f4-88c49ec5c990 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:21.788722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:21.789390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:21.789667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:21.789948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:21.799624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:21.801099 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:21.811701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1111/2219] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:22.077048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:22.078865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:22.099667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79835568-a65b-4b7f-8c26-0a2050b20e3b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:22.105457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:22.106313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:22.106731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:22.107043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] PATH_INFO: `/v3/projects/8c36c7e103fd4a81b51cf9cd5b8beebf` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:22.108238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c36c7e103fd4a81b51cf9cd5b8beebf)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:22.110943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:22.169862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c36c7e103fd4a81b51cf9cd5b8beebf', 'request_id': 'req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.179585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c36c7e103fd4a81b51cf9cd5b8beebf', 'request_id': 'req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.186065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c36c7e103fd4a81b51cf9cd5b8beebf', 'request_id': 'req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.206530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] The token cache is being invalidate because project 8c36c7e103fd4a81b51cf9cd5b8beebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:22.206834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.207540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.210238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1109/2220] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:22 2022] DELETE /identity/v3/projects/8c36c7e103fd4a81b51cf9cd5b8beebf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:22.214467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:22.226697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b44f1-a41b-4e53-910d-8a21d2fad10d service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:22.304225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:22.305312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:22.305803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:22.306132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] PATH_INFO: `/v3/users/9a1672fc4f924d818c8557cea3868a62` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:22.307687 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1672fc4f924d818c8557cea3868a62)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:22.309999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:22.362002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1672fc4f924d818c8557cea3868a62'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.373503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1672fc4f924d818c8557cea3868a62'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.381217 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1672fc4f924d818c8557cea3868a62'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.381982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1672fc4f924d818c8557cea3868a62'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.382587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1672fc4f924d818c8557cea3868a62'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.395649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1112/2221] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:22 2022] DELETE /identity/v3/users/9a1672fc4f924d818c8557cea3868a62 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:22.654698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:22.656308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:22.669905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8855d4-bc5a-4d0b-b453-e3a996f1f61b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:22.731374 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:22.732349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:22.732648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:22.732926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] PATH_INFO: `/v3/projects/7b6e889e24e4402a8a0e86343234c8ee` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:22.734119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6e889e24e4402a8a0e86343234c8ee)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:22.736126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:22.787420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6e889e24e4402a8a0e86343234c8ee', 'request_id': 'req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.794462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6e889e24e4402a8a0e86343234c8ee', 'request_id': 'req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.799607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6e889e24e4402a8a0e86343234c8ee', 'request_id': 'req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.810625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] The token cache is being invalidate because project 7b6e889e24e4402a8a0e86343234c8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:22.810888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.811595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.813133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1110/2222] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:22 2022] DELETE /identity/v3/projects/7b6e889e24e4402a8a0e86343234c8ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:22.817171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:22.818723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:22.832058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183e823-014b-404e-a47a-225acad091d8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:22.888107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:22.888903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:22.889189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:22.889470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] PATH_INFO: `/v3/users/e962dcc40a354acabfa90f08a625f545` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:22.890656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e962dcc40a354acabfa90f08a625f545)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:22.892861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:22.936885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e962dcc40a354acabfa90f08a625f545'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.947949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e962dcc40a354acabfa90f08a625f545'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.954815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e962dcc40a354acabfa90f08a625f545'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.955423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e962dcc40a354acabfa90f08a625f545'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.956016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e962dcc40a354acabfa90f08a625f545'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:22.967988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1113/2223] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:22 2022] DELETE /identity/v3/users/e962dcc40a354acabfa90f08a625f545 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:23.227291 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:23.228739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:23.243896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0d88c-6dca-46ad-9d1a-f8b0af842550 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:23.301951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:23.302803 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:23.303081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:23.303410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] PATH_INFO: `/v3/projects/affdc559141f4557b88cab4a1134c37f` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:23.304576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=affdc559141f4557b88cab4a1134c37f)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:23.306678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:23.360309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affdc559141f4557b88cab4a1134c37f', 'request_id': 'req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:23.368386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affdc559141f4557b88cab4a1134c37f', 'request_id': 'req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:23.374819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affdc559141f4557b88cab4a1134c37f', 'request_id': 'req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:23.388075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] The token cache is being invalidate because project affdc559141f4557b88cab4a1134c37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:23.388560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:23.389405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e7fce3be-b0c1-43cc-824b-9e38ad3eacbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:23.391691 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1111/2224] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:23 2022] DELETE /identity/v3/projects/affdc559141f4557b88cab4a1134c37f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:29.589841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:29.591353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:29.603692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c93ea-adce-469f-967c-4ce12c2d46e5 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:29.663308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:29.664308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:29.664690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:29.665066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] PATH_INFO: `/v3/users/708bb893b531410399fda432edbbae6b` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:29.666365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708bb893b531410399fda432edbbae6b)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:29.669015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:29.715245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708bb893b531410399fda432edbbae6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:29.727937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708bb893b531410399fda432edbbae6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:29.737366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708bb893b531410399fda432edbbae6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:29.738108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708bb893b531410399fda432edbbae6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:29.738766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708bb893b531410399fda432edbbae6b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:29.752710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1114/2225] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:29 2022] DELETE /identity/v3/users/708bb893b531410399fda432edbbae6b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:29.756924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:29.757421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:29.757539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:29.775948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:29.780492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:29.845819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1112/2226] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:29.852412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:29.854917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:29.910266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bb68-5a05-401e-b5ab-4b52f71ecb08 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:29.914061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a786b6c-3a66-4f70-af27-f0535409ba6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:29.914710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786b6c-3a66-4f70-af27-f0535409ba6d service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:29.914997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786b6c-3a66-4f70-af27-f0535409ba6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:29.915317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a786b6c-3a66-4f70-af27-f0535409ba6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:29.924639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a786b6c-3a66-4f70-af27-f0535409ba6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:29.926058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a786b6c-3a66-4f70-af27-f0535409ba6d service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:29.935914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1115/2227] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:30.189891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:30.191407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:30.203769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2d785-6f60-4b11-afbc-bd95ba983e97 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:30.209048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:30.210061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:30.210408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:30.210822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] PATH_INFO: `/v3/projects/9d8b5a05a9574529933257869bccbe11` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:30.212471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8b5a05a9574529933257869bccbe11)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:30.215387 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:30.263236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8b5a05a9574529933257869bccbe11', 'request_id': 'req-735ef141-4874-40e7-a1ec-46609ec80b10'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:30.270232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8b5a05a9574529933257869bccbe11', 'request_id': 'req-735ef141-4874-40e7-a1ec-46609ec80b10'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:30.275513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8b5a05a9574529933257869bccbe11', 'request_id': 'req-735ef141-4874-40e7-a1ec-46609ec80b10'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:30.286902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] The token cache is being invalidate because project 9d8b5a05a9574529933257869bccbe11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:30.287207 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:30.287837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:30.289386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1113/2228] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:30 2022] DELETE /identity/v3/projects/9d8b5a05a9574529933257869bccbe11 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:34.864164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409673-f3eb-4feb-bb54-e6acb32b2dfa None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:34.864600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409673-f3eb-4feb-bb54-e6acb32b2dfa None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:34.864707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409673-f3eb-4feb-bb54-e6acb32b2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:34.882655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0a409673-f3eb-4feb-bb54-e6acb32b2dfa None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:34.883884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0a409673-f3eb-4feb-bb54-e6acb32b2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:34.937120 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1116/2229] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:44:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:34.977244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:34.978638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:35.045598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ef141-4874-40e7-a1ec-46609ec80b10 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:35.050466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:35.051117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:35.051438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:35.051715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:35.059582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:35.061213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:35.069276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1114/2230] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:44:35.587564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aecf7-9848-4c50-a295-aa3bfa274268 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:35.587862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aecf7-9848-4c50-a295-aa3bfa274268 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:35.588157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aecf7-9848-4c50-a295-aa3bfa274268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:35.611977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b30aecf7-9848-4c50-a295-aa3bfa274268 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:35.613102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b30aecf7-9848-4c50-a295-aa3bfa274268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:35.620284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1117/2231] 10.222.0.45 () {58 vars in 967 bytes} [Fri Apr 29 18:44:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:35.634345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:35.644878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2566-5b81-4d3a-b6c1-a72a1add9061 service swift] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:35.651904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:35.652556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:35.652870 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:35.653148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:35.662050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:35.663762 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:35.672547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1115/2232] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:44:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:44:35.889192 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535970-c9db-4dff-886b-e4ea847b9299 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:35.889647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535970-c9db-4dff-886b-e4ea847b9299 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:35.889849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535970-c9db-4dff-886b-e4ea847b9299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:35.911312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ae535970-c9db-4dff-886b-e4ea847b9299 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:35.912697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ae535970-c9db-4dff-886b-e4ea847b9299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:35.921097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1118/2233] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:44:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:35.932980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:35.943721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983561df-ccf1-4192-8451-ef4be3c4e5d0 service swift] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:35.949415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:35.950081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:35.950408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:35.950692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:35.958884 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:35.960546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:35.969571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1116/2234] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:44:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:44:36.290880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:36.291199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:36.291483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:36.319483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:36.320697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:36.328464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1119/2235] 10.222.0.45 () {58 vars in 967 bytes} [Fri Apr 29 18:44:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:36.341346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:36.371018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa275785-fd16-40d6-b462-d96e4e91b054 service swift] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:36.376108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4313-241c-4a00-84d3-c9f21648274f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:36.376686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4313-241c-4a00-84d3-c9f21648274f service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:36.376972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4313-241c-4a00-84d3-c9f21648274f service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:36.377248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4313-241c-4a00-84d3-c9f21648274f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:36.385174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c4313-241c-4a00-84d3-c9f21648274f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:36.387474 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c4313-241c-4a00-84d3-c9f21648274f service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:36.398675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1117/2236] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:44:38.418947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:38.420803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:38.522895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020392c-67b1-4a4b-bd44-bfe50c71f333 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:38.527918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:38.528794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:38.529083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:38.529362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] PATH_INFO: `/v3/users/ce9e4900147944a39ddce372eccb15d6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:38.530581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9e4900147944a39ddce372eccb15d6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:38.532546 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:38.584398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9e4900147944a39ddce372eccb15d6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:38.599851 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9e4900147944a39ddce372eccb15d6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:38.607220 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9e4900147944a39ddce372eccb15d6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:38.607928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9e4900147944a39ddce372eccb15d6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:38.608565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9e4900147944a39ddce372eccb15d6'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:38.621188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1120/2237] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:38 2022] DELETE /identity/v3/users/ce9e4900147944a39ddce372eccb15d6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:38.625801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:38.626292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:38.626383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:38.652675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:38.653879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:38.712702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1118/2238] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:38.722552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:38.723987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:38.814475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e38f6b-4f20-4f25-9f86-97562629630e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:38.818105 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6161d6-4839-4293-82f6-bb883f2574c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:38.818743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6161d6-4839-4293-82f6-bb883f2574c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:38.819025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6161d6-4839-4293-82f6-bb883f2574c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:38.819328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6161d6-4839-4293-82f6-bb883f2574c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:38.828054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6161d6-4839-4293-82f6-bb883f2574c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:38.829462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6161d6-4839-4293-82f6-bb883f2574c1 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:38.838690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1121/2239] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:39.000791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.002685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:39.021400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbb401-3527-4cf2-8d5c-ef558a5b8a18 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.032282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.033159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.033443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.033716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] PATH_INFO: `/v3/projects/cba02e43a4f64e8792f0b78cd68514eb` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.035001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba02e43a4f64e8792f0b78cd68514eb)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.037010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.083889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba02e43a4f64e8792f0b78cd68514eb', 'request_id': 'req-6938b841-d2d3-4b49-a81a-ac76b8432c01'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:39.092439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba02e43a4f64e8792f0b78cd68514eb', 'request_id': 'req-6938b841-d2d3-4b49-a81a-ac76b8432c01'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:39.098862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba02e43a4f64e8792f0b78cd68514eb', 'request_id': 'req-6938b841-d2d3-4b49-a81a-ac76b8432c01'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:39.112196 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] The token cache is being invalidate because project cba02e43a4f64e8792f0b78cd68514eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:39.112481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:39.113125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-6938b841-d2d3-4b49-a81a-ac76b8432c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:39.114947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1119/2240] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:38 2022] DELETE /identity/v3/projects/cba02e43a4f64e8792f0b78cd68514eb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:39.119840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.120208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.120562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.160428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:39.161617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:39.217872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1122/2241] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:39.225721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.226008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.226284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.246342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:39.247569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:39.255423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1120/2242] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:39.259641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.269384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5e2b-8d96-4a7e-89f1-a1662568133e None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.273937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.274587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.274875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.275192 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.276408 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:44:39.276718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.278309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.289311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1123/2243] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:44:39.294076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.303297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a4f0b-777c-496c-a20d-cabae404b120 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.307979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.308621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.308905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.309181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.309872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.311860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.335435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1121/2244] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:39 2022] POST /identity/v3/projects => generated 397 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:39.339600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.349431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74fd1-134b-48e0-8b62-05ca565d8c5e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.402534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.403222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.403514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.403794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.404528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.406503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.425510 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1124/2245] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:39 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:39.429499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.442162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567fec9-7a2e-47ce-9ec8-aeb8375114b7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.448386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.449060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.449349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.449626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.450360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.452019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.465867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1122/2246] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:39.469979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.479677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db0b71-27f0-4c04-a8c8-47b6619aa6ea admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.484312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d34c6-e2f8-4074-9c17-d140fd155471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.484975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d34c6-e2f8-4074-9c17-d140fd155471 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.485262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d34c6-e2f8-4074-9c17-d140fd155471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.485538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d34c6-e2f8-4074-9c17-d140fd155471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.486247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d34c6-e2f8-4074-9c17-d140fd155471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.487895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d34c6-e2f8-4074-9c17-d140fd155471 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.500896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1125/2247] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:39.502100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.512707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c1ca-e922-4133-8e3b-960b2a2a981e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.517642 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.518541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.518826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.519133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] PATH_INFO: `/v3/projects/ece9cf828ff24c40b021015a2ad15d5c/users/59b313d3cc4240bbb32a7ba258651cfb/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.533867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece9cf828ff24c40b021015a2ad15d5c, user_id=59b313d3cc4240bbb32a7ba258651cfb, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.536583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.550176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1123/2248] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:39 2022] PUT /identity/v3/projects/ece9cf828ff24c40b021015a2ad15d5c/users/59b313d3cc4240bbb32a7ba258651cfb/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:39.560993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.561411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.561701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.588487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] MFA Rules not processed for user `59b313d3cc4240bbb32a7ba258651cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:39.590203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:39.655131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1126/2249] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:39.666341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:39.668073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:39.733147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d1219-502f-479e-ac7a-bb2106a45aea admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:39.742733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:39.742733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:39.742733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:39.742733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:39.746987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:39.748452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:39.757411 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1124/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:44.632179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:44.633595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:44.694920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:44.699407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250541e8-7f1e-46db-91f0-5c4915606db6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:44.703886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:44.704765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:44.705048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:44.705325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] PATH_INFO: `/v3/users/346742be39c047b2ac2507b34df21284` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:44.705505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccc34-5599-4f57-8445-64fda1ce8466 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:44.706507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=346742be39c047b2ac2507b34df21284)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:44.708507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:44.710124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:44.710974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:44.711278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:44.711557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] PATH_INFO: `/v3/users/59b313d3cc4240bbb32a7ba258651cfb` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:44.712760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b313d3cc4240bbb32a7ba258651cfb)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:44.714659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:44.756787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346742be39c047b2ac2507b34df21284'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.760458 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b313d3cc4240bbb32a7ba258651cfb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.768189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346742be39c047b2ac2507b34df21284'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.772316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b313d3cc4240bbb32a7ba258651cfb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.775809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346742be39c047b2ac2507b34df21284'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.776441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346742be39c047b2ac2507b34df21284'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.777092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-452f405c-8680-4c86-a455-a1d551bdc18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346742be39c047b2ac2507b34df21284'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.779453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b313d3cc4240bbb32a7ba258651cfb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.780052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b313d3cc4240bbb32a7ba258651cfb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.786748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b313d3cc4240bbb32a7ba258651cfb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:44.789491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1127/2251] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:44 2022] DELETE /identity/v3/users/346742be39c047b2ac2507b34df21284 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:44.792746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1125/2252] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:44 2022] DELETE /identity/v3/users/59b313d3cc4240bbb32a7ba258651cfb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:44.797301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:44.797889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:44.798313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:44.816953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:44.818183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:44.885718 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1128/2253] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:44.893202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:44.894688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:44.952902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64954-a9b9-49f4-b4dd-099d0a16d317 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:44.956559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:44.957202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:44.957486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:44.957757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:44.966991 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:44.968452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:44.978091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1126/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:45.040145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.041785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.058507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3ff6-b88f-4bc1-9f6a-b61bb999515c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.069776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.071139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.071963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.072253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] PATH_INFO: `/v3/projects/14730e5c83574ffc8f9c2d34551a697c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.073793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14730e5c83574ffc8f9c2d34551a697c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.076009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.127998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14730e5c83574ffc8f9c2d34551a697c', 'request_id': 'req-26d5ae84-cb70-4583-9c90-4a1abe273848'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.138059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14730e5c83574ffc8f9c2d34551a697c', 'request_id': 'req-26d5ae84-cb70-4583-9c90-4a1abe273848'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.145957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14730e5c83574ffc8f9c2d34551a697c', 'request_id': 'req-26d5ae84-cb70-4583-9c90-4a1abe273848'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.158609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] The token cache is being invalidate because project 14730e5c83574ffc8f9c2d34551a697c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:45.158900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.164909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.166556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1129/2255] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:45 2022] DELETE /identity/v3/projects/14730e5c83574ffc8f9c2d34551a697c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:45.171141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.180631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239094a2-40c8-4dc4-bde5-32bf4dd31754 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.237649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.238527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.238810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.239087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] PATH_INFO: `/v3/users/49edbeffdbd842a5b1b603c44745a122` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.240300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49edbeffdbd842a5b1b603c44745a122)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.242235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.264935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.266647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.280993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ae84-cb70-4583-9c90-4a1abe273848 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.286175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.287156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.287512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.287863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] PATH_INFO: `/v3/projects/ece9cf828ff24c40b021015a2ad15d5c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.289178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece9cf828ff24c40b021015a2ad15d5c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.291264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.295605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49edbeffdbd842a5b1b603c44745a122'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.308860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49edbeffdbd842a5b1b603c44745a122'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.315984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49edbeffdbd842a5b1b603c44745a122'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.316592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49edbeffdbd842a5b1b603c44745a122'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.324104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f30eb7b3-ad8d-4935-88ed-aebf37740d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49edbeffdbd842a5b1b603c44745a122'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.330304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1127/2256] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:44:45 2022] DELETE /identity/v3/users/49edbeffdbd842a5b1b603c44745a122 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:45.341281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece9cf828ff24c40b021015a2ad15d5c', 'request_id': 'req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.350307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece9cf828ff24c40b021015a2ad15d5c', 'request_id': 'req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.356859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece9cf828ff24c40b021015a2ad15d5c', 'request_id': 'req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.368050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] The token cache is being invalidate because project ece9cf828ff24c40b021015a2ad15d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:45.368434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.369160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3494d28a-7b88-40b3-8283-fccf4e1a2b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.370790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1130/2257] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:45 2022] DELETE /identity/v3/projects/ece9cf828ff24c40b021015a2ad15d5c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:45.376139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.376405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.376684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.394666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:45.395896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.456071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1128/2258] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:45.463999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.464293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.464571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.484443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:45.486005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.495484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1131/2259] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:45.499823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.507223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.508934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.510058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db13cf-2e3a-4da6-9419-4d81aa8a0852 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.515342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.516011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.516299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.516845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.517587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:44:45.517927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.519571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.524572 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd0c1-6264-4375-bda8-1da4909dcdce None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.530006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.531094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.531591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.532019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] PATH_INFO: `/v3/projects/1ea3e2b01e9a49de99fa624ef79ea201` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.532744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1129/2260] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:44:45.533504 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea3e2b01e9a49de99fa624ef79ea201)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.535566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.537163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.547748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f5ffb-94bf-4be0-a5ef-6a24666352a4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.552572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.553324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.553680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.554032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.554724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.557118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.584033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1130/2261] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:45.584765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea3e2b01e9a49de99fa624ef79ea201', 'request_id': 'req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.587981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.594114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea3e2b01e9a49de99fa624ef79ea201', 'request_id': 'req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.599635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea3e2b01e9a49de99fa624ef79ea201', 'request_id': 'req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.610473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] The token cache is being invalidate because project 1ea3e2b01e9a49de99fa624ef79ea201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:44:45.610762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.611432 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-047f69ab-1534-4c4d-9a3e-7afdc3cb1921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:44:45.612993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1132/2262] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:44:45 2022] DELETE /identity/v3/projects/1ea3e2b01e9a49de99fa624ef79ea201 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:45.617584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347f1aa-8e99-4deb-a68c-a8e5939daf7a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.617881 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347f1aa-8e99-4deb-a68c-a8e5939daf7a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.618166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347f1aa-8e99-4deb-a68c-a8e5939daf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.635344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6347f1aa-8e99-4deb-a68c-a8e5939daf7a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:45.636474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6347f1aa-8e99-4deb-a68c-a8e5939daf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.648970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2545-a59d-4d69-8683-d1dba28a1591 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.654154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.654810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.655089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.655393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.656069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.657972 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.680908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1131/2263] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:45.681948 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.683667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.695445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61119031-de6b-46ff-b5dc-c74e262d8ed7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.696141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1133/2264] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:45.703938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.704233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.704518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.704795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.705488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.705783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.706069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.706829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.708483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.719786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1132/2265] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:45.723673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.724764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:45.725970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.733377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883fcf4-7763-406b-afd5-a98e3c556022 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.734076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1134/2266] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:45.738093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.738246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.738891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.739217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.739506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.740229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.741822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.746902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71626253-05e8-445a-bba8-ad8dd976d3ed None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.751430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.752070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.755199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1133/2267] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:44:45.755340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.755340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.755340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:44:45.755340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.755631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.756255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.766135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8475c58-a35b-4161-811f-6a8f3b4101b6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.770701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1135/2268] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:44:45.771804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.776679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e082-c35b-4af9-99a3-634e461625b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.778157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e082-c35b-4af9-99a3-634e461625b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.778443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e082-c35b-4af9-99a3-634e461625b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.778723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e082-c35b-4af9-99a3-634e461625b8 admin admin] PATH_INFO: `/v3/projects/4d33d76135cb4dddbcaf0e7228e3b3b5/users/b2fa81478fee4b6182d0595d6dcf0e86/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.782559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5100b-81fd-4664-abe5-cc3bfe2d7a14 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.787163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.787818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.788107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.788525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.789218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.791191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.793333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e082-c35b-4af9-99a3-634e461625b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d33d76135cb4dddbcaf0e7228e3b3b5, user_id=b2fa81478fee4b6182d0595d6dcf0e86, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.796045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e082-c35b-4af9-99a3-634e461625b8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.809898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1134/2269] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:45 2022] PUT /identity/v3/projects/4d33d76135cb4dddbcaf0e7228e3b3b5/users/b2fa81478fee4b6182d0595d6dcf0e86/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:45.814760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.815050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.815355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.817275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1136/2270] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:45.820994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.832986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:45.834183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.882469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307e0b9-7d2f-47fa-8660-962753ca6051 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.887848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.888490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.888781 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.889078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.889752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.892005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.896564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1135/2271] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:45.903320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.905009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:45.916287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1137/2272] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:45 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:44:45.917415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.927205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425868b5-e987-435c-94f3-ed5cfe0140a1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.931877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.932535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.932818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.933098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.934320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.936001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.946106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1138/2273] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:45.950350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.960326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ac15-9b1c-4ac9-892b-99c81d296c5e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.965571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.966287 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.966566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.966853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.967559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5af21-e21e-4cc7-91d7-1d1ef21462a7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.967681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.969278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.971516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af127d37-0aa2-4858-b985-5d6104be2151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:45.972184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af127d37-0aa2-4858-b985-5d6104be2151 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:45.972465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af127d37-0aa2-4858-b985-5d6104be2151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:45.972743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af127d37-0aa2-4858-b985-5d6104be2151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:45.984704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1139/2274] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:44:45.986068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:45.986679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af127d37-0aa2-4858-b985-5d6104be2151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:45.988195 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af127d37-0aa2-4858-b985-5d6104be2151 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:45.996886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a59f0-ddb9-44fd-8a88-adaf828f82d2 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:45.999813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1136/2275] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:44:46.002053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:46.003212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:46.003605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:46.003998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] PATH_INFO: `/v3/projects/6b3dd7c995454f22ba3312539a314018/users/91f446b60fff4d09b45d5225eda85d26/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:46.023016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3dd7c995454f22ba3312539a314018, user_id=91f446b60fff4d09b45d5225eda85d26, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:46.025971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:46.041168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1140/2276] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:45 2022] PUT /identity/v3/projects/6b3dd7c995454f22ba3312539a314018/users/91f446b60fff4d09b45d5225eda85d26/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:44:46.056641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d021-e82a-4e72-99cd-b1101de57647 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:46.056937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d021-e82a-4e72-99cd-b1101de57647 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:46.057220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d021-e82a-4e72-99cd-b1101de57647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:46.097635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f916d021-e82a-4e72-99cd-b1101de57647 None None] MFA Rules not processed for user `91f446b60fff4d09b45d5225eda85d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:46.098846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f916d021-e82a-4e72-99cd-b1101de57647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:46.172109 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1137/2277] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:46.184619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:46.186346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:46.248456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65407c1-6548-48f8-b672-63bcef4d27c7 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:46.252316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:46.252979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:46.253263 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:46.253540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:46.262619 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:46.263776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:46.272907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1141/2278] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:44:50.622777 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:50.623342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:50.623342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:50.660945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] MFA Rules not processed for user `b2fa81478fee4b6182d0595d6dcf0e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:50.662628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:50.736583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1138/2279] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:44:50.740969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:50.803950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299ba8-5e36-487a-ad3f-6cb1a3ed3b08 service glance] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:50.809111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:50.809769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:50.810049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:50.810350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:50.811045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:50.812965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:50.837346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1142/2280] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:44:50 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:50.841327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:50.851860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070a637-17b9-4f9f-b9cc-aab58504a79f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:50.923191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:50.923891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:50.924227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:50.924612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:50.925316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:50.927263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:50.947944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1139/2281] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:44:50 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:44:50.951814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:50.961939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bdcfc-5bf2-4011-b7eb-6b3a11c2772d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:50.966444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:50.967097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:50.967474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:50.967749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:50.968477 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:50.970057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:50.980093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1143/2282] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:50.984539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:50.994031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529e539-55ce-441a-b1eb-da614f65dd26 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:50.999292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:51.000157 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:51.000438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:51.000714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] PATH_INFO: `/v3/projects/dd7095df1d9447b3876e6ceb28d5cfd1/users/60b590ae8c3a405b9d6d1b92b578a7a2/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:51.016091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7095df1d9447b3876e6ceb28d5cfd1, user_id=60b590ae8c3a405b9d6d1b92b578a7a2, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:51.019695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:51.035485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1140/2283] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:50 2022] PUT /identity/v3/projects/dd7095df1d9447b3876e6ceb28d5cfd1/users/60b590ae8c3a405b9d6d1b92b578a7a2/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:51.039445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:51.049825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53f25-828a-423f-80d3-ed35a87f46c4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:51.104878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45eac74-e043-46ee-af22-3abf5a4ea0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:51.106176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eac74-e043-46ee-af22-3abf5a4ea0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:51.106460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eac74-e043-46ee-af22-3abf5a4ea0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:51.106737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eac74-e043-46ee-af22-3abf5a4ea0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:51.107517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45eac74-e043-46ee-af22-3abf5a4ea0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:51.109124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45eac74-e043-46ee-af22-3abf5a4ea0b7 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:51.121933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1144/2284] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:44:51.123271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:51.133503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff249f-eea2-451a-a9fd-711ce8b601c5 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:51.140835 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:51.142228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:51.142721 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:51.143355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] PATH_INFO: `/v3/projects/dd7095df1d9447b3876e6ceb28d5cfd1/users/60b590ae8c3a405b9d6d1b92b578a7a2/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:51.150072 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7095df1d9447b3876e6ceb28d5cfd1, user_id=60b590ae8c3a405b9d6d1b92b578a7a2, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:51.158636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:51.171137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1141/2285] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:44:51 2022] PUT /identity/v3/projects/dd7095df1d9447b3876e6ceb28d5cfd1/users/60b590ae8c3a405b9d6d1b92b578a7a2/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:44:56.360567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6a33-bcb7-4df0-8884-4a5836de139c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:56.361795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6a33-bcb7-4df0-8884-4a5836de139c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:56.362353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6a33-bcb7-4df0-8884-4a5836de139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:56.402635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d1bd6a33-bcb7-4df0-8884-4a5836de139c None None] MFA Rules not processed for user `60b590ae8c3a405b9d6d1b92b578a7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:56.404288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d1bd6a33-bcb7-4df0-8884-4a5836de139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:56.500457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1145/2286] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:44:56.512729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:44:56.514592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:56.595414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7d16-e909-4763-961b-a1095607c1bf admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:44:56.600790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:44:56.601456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:56.601738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:56.602017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:56.659049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:44:56.660735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:44:56.670422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1142/2287] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:44:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:44:57.950413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8a9b-80c4-4dc5-94f6-eaf54c4ff731 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:44:57.950929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8a9b-80c4-4dc5-94f6-eaf54c4ff731 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:44:57.951031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8a9b-80c4-4dc5-94f6-eaf54c4ff731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:44:57.968611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9aaa8a9b-80c4-4dc5-94f6-eaf54c4ff731 None None] MFA Rules not processed for user `b2fa81478fee4b6182d0595d6dcf0e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:44:57.969804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9aaa8a9b-80c4-4dc5-94f6-eaf54c4ff731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:44:57.976658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1146/2288] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:44:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:45:08.177471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:08.238493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092ad9-a964-458e-8fed-dd61fa1d016e service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:08.243403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:08.244310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:08.244595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:08.244896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] PATH_INFO: `/v3/users/91f446b60fff4d09b45d5225eda85d26` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:08.246158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f446b60fff4d09b45d5225eda85d26)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:08.248118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:08.295481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f446b60fff4d09b45d5225eda85d26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.309342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f446b60fff4d09b45d5225eda85d26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.317079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f446b60fff4d09b45d5225eda85d26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.317724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f446b60fff4d09b45d5225eda85d26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.324343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f446b60fff4d09b45d5225eda85d26'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.330832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1143/2289] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:45:08 2022] DELETE /identity/v3/users/91f446b60fff4d09b45d5225eda85d26 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:08.335193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:08.335652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:08.335770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:08.352758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:08.353964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:08.411944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1147/2290] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:45:08.421407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:08.422966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:08.480636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94707eb0-acb0-4b06-b0dc-01d91a80b316 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:08.484436 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7269-4db8-4475-a39b-6c8e3371609d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:08.485082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7269-4db8-4475-a39b-6c8e3371609d service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:08.485371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7269-4db8-4475-a39b-6c8e3371609d service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:08.485646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7269-4db8-4475-a39b-6c8e3371609d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:08.494473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7269-4db8-4475-a39b-6c8e3371609d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:08.495944 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7269-4db8-4475-a39b-6c8e3371609d service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:08.506592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1144/2291] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:08.772987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:08.774416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:08.786505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bfb98-e0fe-4544-9582-b1bb89f3fbd8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:08.796722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:08.797620 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:08.797906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:08.798184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] PATH_INFO: `/v3/projects/6b3dd7c995454f22ba3312539a314018` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:08.799460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3dd7c995454f22ba3312539a314018)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:08.801386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:08.854182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3dd7c995454f22ba3312539a314018', 'request_id': 'req-46c62f8e-a425-49d0-9840-5dcac9349c19'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.861917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3dd7c995454f22ba3312539a314018', 'request_id': 'req-46c62f8e-a425-49d0-9840-5dcac9349c19'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.867843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3dd7c995454f22ba3312539a314018', 'request_id': 'req-46c62f8e-a425-49d0-9840-5dcac9349c19'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.879559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] The token cache is being invalidate because project 6b3dd7c995454f22ba3312539a314018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:45:08.879983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.880805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-46c62f8e-a425-49d0-9840-5dcac9349c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:08.882373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1148/2292] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:45:08 2022] DELETE /identity/v3/projects/6b3dd7c995454f22ba3312539a314018 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:08.887257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:08.887552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:08.887829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:08.915319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:08.917008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:08.979511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1145/2293] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:08.987937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:08.988226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:08.988508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.010297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:09.011803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:09.023035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1149/2294] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:09.028245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.041444 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b50ae-6ac4-4936-9e4a-989a90bd63a5 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.048664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.049629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.050185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.050668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.052120 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:45:09.052593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.054549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.070136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1146/2295] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:45:09.071235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.081043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b32c2-11d1-482a-986b-ee61dc2353e9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.085983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.086631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.086914 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.087225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.087916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.089809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.116893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1150/2296] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:45:09.121007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.131003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f64b5-7a23-48a5-b6ff-77a4cfae3b05 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.186418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.187316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.187655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.187888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.188827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.190778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.211512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1147/2297] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:45:09.215734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.226883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd945a-ca6c-459f-bea0-8c4a5030ae25 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.231565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.232240 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.232526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.232836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.234142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.235792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.247313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1151/2298] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:09.251705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.261331 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a8d9-a048-4149-b7bc-d244f9292fc6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.266801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e232f-9832-4f29-bd6b-ae9282a91b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.267605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e232f-9832-4f29-bd6b-ae9282a91b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.267963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e232f-9832-4f29-bd6b-ae9282a91b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.268249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e232f-9832-4f29-bd6b-ae9282a91b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.268995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e232f-9832-4f29-bd6b-ae9282a91b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.270637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e232f-9832-4f29-bd6b-ae9282a91b25 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.281491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1148/2299] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:09.285646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.296387 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbc806-d944-4bd2-b902-5359fb99e019 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.300975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.301890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.302183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.302466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] PATH_INFO: `/v3/projects/27e0877fd2ec468aa2e232ff9b920a64/users/7c1ceebcabc04b819d424dfe93ddbda2/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.317885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e0877fd2ec468aa2e232ff9b920a64, user_id=7c1ceebcabc04b819d424dfe93ddbda2, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.320935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.334880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1152/2300] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:45:09 2022] PUT /identity/v3/projects/27e0877fd2ec468aa2e232ff9b920a64/users/7c1ceebcabc04b819d424dfe93ddbda2/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:09.346709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.347050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.347354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.375037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] MFA Rules not processed for user `7c1ceebcabc04b819d424dfe93ddbda2`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:09.376328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:09.446989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1149/2301] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:09.450846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.515279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d3e77-39bd-4ce1-aefd-d70a30484554 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.520324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.521045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.521353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.521631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.522321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.524386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.550447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1153/2302] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:45:09.554836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.566552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282c31-2690-4f80-8141-9fb95f0ec55a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.621495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.622449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.622728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.623000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.623715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.625722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.646303 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1150/2303] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:45:09.650255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.660957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090f107-054e-44b6-b90e-16966c9c0593 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.665918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.666584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.666872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.667165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.667915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.669551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.680539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1154/2304] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:09.685419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.697878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592b0a1-c592-4718-ac23-34e6d6eec753 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.703091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179778f-5df2-4d62-9e0f-32eec1a45acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.703794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179778f-5df2-4d62-9e0f-32eec1a45acb admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.704091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179778f-5df2-4d62-9e0f-32eec1a45acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.704367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179778f-5df2-4d62-9e0f-32eec1a45acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.705097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179778f-5df2-4d62-9e0f-32eec1a45acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.706714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179778f-5df2-4d62-9e0f-32eec1a45acb admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.716894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1151/2305] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:09.721140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.730900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c09e-d080-43a6-85f7-49ee72228be6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.736437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.737351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.737638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.737917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] PATH_INFO: `/v3/projects/00a6d1c92eba489eb452109e0a4b0e85/users/c5a3e7459b9f41418947c32d5e987593/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.752746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a6d1c92eba489eb452109e0a4b0e85, user_id=c5a3e7459b9f41418947c32d5e987593, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.755499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.769680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1155/2306] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:45:09 2022] PUT /identity/v3/projects/00a6d1c92eba489eb452109e0a4b0e85/users/c5a3e7459b9f41418947c32d5e987593/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:09.779895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13517f35-79c0-4787-bc58-6224944593aa None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.780224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13517f35-79c0-4787-bc58-6224944593aa None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.780506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13517f35-79c0-4787-bc58-6224944593aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.806689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-13517f35-79c0-4787-bc58-6224944593aa None None] MFA Rules not processed for user `c5a3e7459b9f41418947c32d5e987593`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:09.807951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-13517f35-79c0-4787-bc58-6224944593aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:09.870677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1152/2307] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:09.875635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.938804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e15f8-0978-408c-915f-a47683ca4b99 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:09.943583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:09.944261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:09.944542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:09.944816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:09.945517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:09.947442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:09.974900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1156/2308] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:45:09.978957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13517f35-79c0-4787-bc58-6224944593aa None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:09.990088 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13517f35-79c0-4787-bc58-6224944593aa None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:10.050833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:10.051531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.051813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.052100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.052768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:10.054687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:10.075270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1153/2309] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:45:09 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:45:10.079307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:10.089225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faa4ed-fee7-443a-8f39-e7fcbecc5e59 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:10.093726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:10.094379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.094662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.094937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.095706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:10.097289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:10.107363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1157/2310] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:10.111658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:10.121378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036700-fb16-4db5-bec3-09f0cd10b185 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:10.126679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:10.127583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.127865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.128140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] PATH_INFO: `/v3/projects/8c989204920b46c7bb52f8163e1dceef/users/189ca5d95da04dbc93e3901288605cb9/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.142526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c989204920b46c7bb52f8163e1dceef, user_id=189ca5d95da04dbc93e3901288605cb9, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:10.145233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:10.157101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1154/2311] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:45:10 2022] PUT /identity/v3/projects/8c989204920b46c7bb52f8163e1dceef/users/189ca5d95da04dbc93e3901288605cb9/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:45:10.160934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:10.170476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffc76-60be-4fe2-9cbf-888491d67aec admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:10.223093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff893-5e5d-445a-bf34-b10ead8f902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:10.223719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff893-5e5d-445a-bf34-b10ead8f902e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.223999 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff893-5e5d-445a-bf34-b10ead8f902e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.224273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff893-5e5d-445a-bf34-b10ead8f902e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.224988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff893-5e5d-445a-bf34-b10ead8f902e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:10.226566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff893-5e5d-445a-bf34-b10ead8f902e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:10.236410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1158/2312] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:10.240362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:10.251042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aa216-dc84-4bfa-8302-ce78e08221f1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:10.255695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:10.256563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.256846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.257119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] PATH_INFO: `/v3/projects/8c989204920b46c7bb52f8163e1dceef/users/189ca5d95da04dbc93e3901288605cb9/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.259066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c989204920b46c7bb52f8163e1dceef, user_id=189ca5d95da04dbc93e3901288605cb9, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:10.261731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:10.271860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1155/2313] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:45:10 2022] PUT /identity/v3/projects/8c989204920b46c7bb52f8163e1dceef/users/189ca5d95da04dbc93e3901288605cb9/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:45:10.281869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.282170 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.282454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.308676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] MFA Rules not processed for user `189ca5d95da04dbc93e3901288605cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:10.309873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:10.375124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1159/2314] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:10.386409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:10.388197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:10.464136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaafbdb-f095-42d5-81c5-9a339b24137a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:10.468289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:10.468927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:10.469213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:10.469486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:10.522085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:10.523488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:10.532587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1156/2315] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:11.995149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:12.004522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7baf82-62c0-4f68-a51a-9ffa28c96f91 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:12.008333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:12.008975 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:12.009261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:12.009539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:12.064007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:12.065624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:12.075550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1160/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:12.586931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:12.596017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192e296-caaa-4505-b8f4-c410eea06659 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:12.599525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2677f-ac8b-4220-ae0e-1243896d8139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:12.600151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2677f-ac8b-4220-ae0e-1243896d8139 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:12.600456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2677f-ac8b-4220-ae0e-1243896d8139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:12.600729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2677f-ac8b-4220-ae0e-1243896d8139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:12.609390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2677f-ac8b-4220-ae0e-1243896d8139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:12.610805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2677f-ac8b-4220-ae0e-1243896d8139 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:12.619864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1157/2317] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:16.418183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:16.478592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00748d5-0f6a-4f41-aa4c-d97b739c4c25 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:16.483122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:16.484640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:16.484938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:16.485208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] PATH_INFO: `/v3/users/7c1ceebcabc04b819d424dfe93ddbda2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:16.486400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1ceebcabc04b819d424dfe93ddbda2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:16.488369 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:16.532980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1ceebcabc04b819d424dfe93ddbda2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:16.544277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1ceebcabc04b819d424dfe93ddbda2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:16.551709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1ceebcabc04b819d424dfe93ddbda2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:16.552339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1ceebcabc04b819d424dfe93ddbda2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:16.552953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1ceebcabc04b819d424dfe93ddbda2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:16.564583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1161/2318] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:45:16 2022] DELETE /identity/v3/users/7c1ceebcabc04b819d424dfe93ddbda2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:16.569095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:16.569584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:16.569697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:16.586119 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:16.587354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:16.642931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1158/2319] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:45:16.652489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:16.653880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:16.708595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9877-2bfb-4bbb-8ad0-ce2c47a88584 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:16.712231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:16.712870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:16.713156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:16.713439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:16.722770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:16.724230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:16.733521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1162/2320] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:17.003042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:17.004772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:17.018871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002181b-dfac-4162-9d8a-352fc7cda118 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:17.023537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:17.024415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:17.024692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:17.024962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] PATH_INFO: `/v3/projects/27e0877fd2ec468aa2e232ff9b920a64` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:17.026164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e0877fd2ec468aa2e232ff9b920a64)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:17.028131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:17.077958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e0877fd2ec468aa2e232ff9b920a64', 'request_id': 'req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.086928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e0877fd2ec468aa2e232ff9b920a64', 'request_id': 'req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.093681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e0877fd2ec468aa2e232ff9b920a64', 'request_id': 'req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.104908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] The token cache is being invalidate because project 27e0877fd2ec468aa2e232ff9b920a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:45:17.105201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.105863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.107544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1159/2321] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:45:17 2022] DELETE /identity/v3/projects/27e0877fd2ec468aa2e232ff9b920a64 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:17.111755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:17.121370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf55e3-3bbb-46e6-972f-cfad35a9515b service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:17.180632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:17.181448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:17.181731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:17.182034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] PATH_INFO: `/v3/users/c5a3e7459b9f41418947c32d5e987593` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:17.183288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a3e7459b9f41418947c32d5e987593)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:17.185212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:17.231794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a3e7459b9f41418947c32d5e987593'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.243337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a3e7459b9f41418947c32d5e987593'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.251151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a3e7459b9f41418947c32d5e987593'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.251912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a3e7459b9f41418947c32d5e987593'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.252574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a3e7459b9f41418947c32d5e987593'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.266317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1163/2322] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:45:17 2022] DELETE /identity/v3/users/c5a3e7459b9f41418947c32d5e987593 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:17.527432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:17.528869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:17.543735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7ba09-50a8-46c6-a9f3-80a0a5122000 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:17.604674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:17.606068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:17.606358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:17.606633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] PATH_INFO: `/v3/projects/00a6d1c92eba489eb452109e0a4b0e85` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:17.608036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a6d1c92eba489eb452109e0a4b0e85)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:17.610664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:17.660824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a6d1c92eba489eb452109e0a4b0e85', 'request_id': 'req-ef3816f4-5352-4858-9552-5212cfaf140c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.668512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a6d1c92eba489eb452109e0a4b0e85', 'request_id': 'req-ef3816f4-5352-4858-9552-5212cfaf140c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.675161 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a6d1c92eba489eb452109e0a4b0e85', 'request_id': 'req-ef3816f4-5352-4858-9552-5212cfaf140c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.687530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] The token cache is being invalidate because project 00a6d1c92eba489eb452109e0a4b0e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:45:17.687818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.688471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.690030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1160/2323] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:45:17 2022] DELETE /identity/v3/projects/00a6d1c92eba489eb452109e0a4b0e85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:17.694277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:17.695746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:17.708678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b0090-44ac-4417-a1aa-348295b5c05d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:17.763565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:17.764437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:17.764720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:17.764993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] PATH_INFO: `/v3/users/189ca5d95da04dbc93e3901288605cb9` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:17.766173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189ca5d95da04dbc93e3901288605cb9)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:17.768383 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:17.816415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189ca5d95da04dbc93e3901288605cb9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.827556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189ca5d95da04dbc93e3901288605cb9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.834633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189ca5d95da04dbc93e3901288605cb9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.835276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189ca5d95da04dbc93e3901288605cb9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.835877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-5d2d09af-8bb0-4c4b-b503-a77652daf988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189ca5d95da04dbc93e3901288605cb9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:17.847906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1164/2324] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:45:17 2022] DELETE /identity/v3/users/189ca5d95da04dbc93e3901288605cb9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:45:18.178701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.180169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:18.192984 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3816f4-5352-4858-9552-5212cfaf140c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.248485 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.249410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.249690 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.249955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] PATH_INFO: `/v3/projects/8c989204920b46c7bb52f8163e1dceef` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.251153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c989204920b46c7bb52f8163e1dceef)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.253069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.299361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c989204920b46c7bb52f8163e1dceef', 'request_id': 'req-d7fcf03e-42c2-46dd-a472-2266932cac83'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:18.306496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c989204920b46c7bb52f8163e1dceef', 'request_id': 'req-d7fcf03e-42c2-46dd-a472-2266932cac83'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:18.311797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c989204920b46c7bb52f8163e1dceef', 'request_id': 'req-d7fcf03e-42c2-46dd-a472-2266932cac83'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:18.322244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] The token cache is being invalidate because project 8c989204920b46c7bb52f8163e1dceef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:45:18.322525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:18.323163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d7fcf03e-42c2-46dd-a472-2266932cac83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:45:18.324684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1161/2325] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:45:18 2022] DELETE /identity/v3/projects/8c989204920b46c7bb52f8163e1dceef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:18.330048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.330342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.330628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.348633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:18.349827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:18.407724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1165/2326] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:18.416323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.416611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.416888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.434452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:18.435669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:18.443491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1162/2327] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:18.447556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.457651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356171-a562-4d93-985d-3c5ffc06736b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.462225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.462886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.463203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.463485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.464214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:45:18.464524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.466121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.478114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1166/2328] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:45:18.482453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.491692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280fbe1-7ebc-4ff9-93db-be6d65070606 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.496287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.496929 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.497216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.497498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.498199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.500283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.525299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1163/2329] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:45:18 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:45:18.529319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.539880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed114f52-d5c1-43b5-813f-421d6c76079c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.594473 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.595175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.595469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.595751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.596450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.598365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.617562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1167/2330] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:45:18 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:45:18.621530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.631480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa26665-7078-4d7d-a1d4-d8684ab51237 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.635978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.636623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.636902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.637177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.637892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.639512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.651639 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1164/2331] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:18.656009 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.665902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7277e-ccd5-4267-b43a-30d77103ad9b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.670527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923b9be-fa92-40ce-bc3a-b7e93b2e88c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.671269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923b9be-fa92-40ce-bc3a-b7e93b2e88c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.671560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923b9be-fa92-40ce-bc3a-b7e93b2e88c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.671844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923b9be-fa92-40ce-bc3a-b7e93b2e88c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.672594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923b9be-fa92-40ce-bc3a-b7e93b2e88c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.674269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923b9be-fa92-40ce-bc3a-b7e93b2e88c8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.684743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1168/2332] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:45:18.688911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.698503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5987-7ffa-4222-ae35-a08e4f0ee88b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.703662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.704514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.704790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.705062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] PATH_INFO: `/v3/projects/908745be8c2247a08d9cfca95e7b8cd4/users/7d6a22b1443f4034b14e5799a3718dc4/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.718963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] RBAC: Authorizing `identity:create_grant(project_id=908745be8c2247a08d9cfca95e7b8cd4, user_id=7d6a22b1443f4034b14e5799a3718dc4, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.721657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.734399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1165/2333] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:45:18 2022] PUT /identity/v3/projects/908745be8c2247a08d9cfca95e7b8cd4/users/7d6a22b1443f4034b14e5799a3718dc4/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:45:18.739383 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7776e-a650-419a-a3c7-a8aeb72ffb6d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.739868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7776e-a650-419a-a3c7-a8aeb72ffb6d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.740006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7776e-a650-419a-a3c7-a8aeb72ffb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.757419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6dd7776e-a650-419a-a3c7-a8aeb72ffb6d None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:18.758614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6dd7776e-a650-419a-a3c7-a8aeb72ffb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:18.815158 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1169/2334] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:18.824516 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:18.826156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:18.881826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7d973-7e9c-49f4-8958-3814ce06221c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:18.885441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:18.886075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:18.886354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:18.886629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:18.896215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:18.897635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:18.906755 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1166/2335] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:19.559312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07aad2-22a4-45f3-b8f9-5e82a7386957 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:19.559615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07aad2-22a4-45f3-b8f9-5e82a7386957 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:19.559913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07aad2-22a4-45f3-b8f9-5e82a7386957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:19.587672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2f07aad2-22a4-45f3-b8f9-5e82a7386957 None None] MFA Rules not processed for user `7d6a22b1443f4034b14e5799a3718dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:19.588874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2f07aad2-22a4-45f3-b8f9-5e82a7386957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:19.653793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1170/2336] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:19.666204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:19.667685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:19.722826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471e408-b3a4-4834-a03a-c7d0c1d4ac91 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:19.726552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434e58-7108-4a2d-a887-eaf3b8eb2659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:19.727223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434e58-7108-4a2d-a887-eaf3b8eb2659 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:19.727511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434e58-7108-4a2d-a887-eaf3b8eb2659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:19.727788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434e58-7108-4a2d-a887-eaf3b8eb2659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:19.736794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99434e58-7108-4a2d-a887-eaf3b8eb2659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:19.738227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99434e58-7108-4a2d-a887-eaf3b8eb2659 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:19.746838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1167/2337] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:21.068820 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:21.069284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:21.069488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:21.087893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] MFA Rules not processed for user `7d6a22b1443f4034b14e5799a3718dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:21.089087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:21.096370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1171/2338] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:32.075058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54cfd2-77bf-4b6b-8c99-364558942706 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:32.075618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54cfd2-77bf-4b6b-8c99-364558942706 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:32.075914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54cfd2-77bf-4b6b-8c99-364558942706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:32.094918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4d54cfd2-77bf-4b6b-8c99-364558942706 None None] MFA Rules not processed for user `fa3948f301e84488b6c3f0a6dc069202`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:32.096255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4d54cfd2-77bf-4b6b-8c99-364558942706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:32.168196 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1168/2339] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:41.347576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:41.357594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213a96-b1c8-4a49-814c-eb1e44cc5960 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:41.361960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:41.362614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:41.362897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:41.363201 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:41.364998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:41.427437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:41.428875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:41.438703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1172/2340] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:41.785462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000d00-2369-4dba-816b-2e8993e4ca95 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:41.785990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000d00-2369-4dba-816b-2e8993e4ca95 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:41.786134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000d00-2369-4dba-816b-2e8993e4ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:41.815742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-53000d00-2369-4dba-816b-2e8993e4ca95 None None] MFA Rules not processed for user `7f0abeff2be84d51854bd3231864669e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:41.816959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-53000d00-2369-4dba-816b-2e8993e4ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:41.875182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1169/2341] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:45:44.249584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:45:44.252241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:44.388424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c1fbf-a2a6-4539-8813-cbe800bb7349 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:45:44.409106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:45:44.410188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:44.410650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:44.411083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:44.413609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:44.436543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:45:44.438570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8f7f9-1ee1-4ad6-b77e-eba398c86d4e service placement] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:45:44.449513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1173/2342] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:45:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:45:52.131564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:45:52.132134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:45:52.132380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:45:52.152709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] MFA Rules not processed for user `7d6a22b1443f4034b14e5799a3718dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:45:52.153936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:45:52.163339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1170/2343] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:45:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:00.618982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f10e6-3f0e-44e1-addb-1d57cb95f069 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:00.619464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f10e6-3f0e-44e1-addb-1d57cb95f069 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:00.619571 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f10e6-3f0e-44e1-addb-1d57cb95f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:00.679331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f02f10e6-3f0e-44e1-addb-1d57cb95f069 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:00.680563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f02f10e6-3f0e-44e1-addb-1d57cb95f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:00.767355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1174/2344] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:00.818205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:00.819622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:00.909829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a95aff-5997-4577-8534-3217d68f0770 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:00.915561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c7740-f152-4ee7-9564-0d530cd405a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:00.916428 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c7740-f152-4ee7-9564-0d530cd405a7 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:00.916971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c7740-f152-4ee7-9564-0d530cd405a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:00.917407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c7740-f152-4ee7-9564-0d530cd405a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:00.926990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c7740-f152-4ee7-9564-0d530cd405a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:00.928633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c7740-f152-4ee7-9564-0d530cd405a7 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:00.938971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1171/2345] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:46:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:46:19.648433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b24a3-a327-4c31-9d74-f724fef6f63c None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:19.649002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b24a3-a327-4c31-9d74-f724fef6f63c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:19.649002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b24a3-a327-4c31-9d74-f724fef6f63c None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:19.650458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1175/2346] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:46:19.657027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e7a9-907f-43ff-81bf-122864d0ec6f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:19.657553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e7a9-907f-43ff-81bf-122864d0ec6f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:19.657553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e7a9-907f-43ff-81bf-122864d0ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:19.714328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b681e7a9-907f-43ff-81bf-122864d0ec6f None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:19.715904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b681e7a9-907f-43ff-81bf-122864d0ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:19.806440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1172/2347] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:46:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:19.818795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b24a3-a327-4c31-9d74-f724fef6f63c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:19.820536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e76b24a3-a327-4c31-9d74-f724fef6f63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:19.901651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b24a3-a327-4c31-9d74-f724fef6f63c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:19.905551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a57b-b61e-4046-b02b-6a982130888f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:19.906850 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a57b-b61e-4046-b02b-6a982130888f service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:19.907157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a57b-b61e-4046-b02b-6a982130888f service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:19.907443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a57b-b61e-4046-b02b-6a982130888f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:19.917854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2a57b-b61e-4046-b02b-6a982130888f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:19.919318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2a57b-b61e-4046-b02b-6a982130888f service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:19.930341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1176/2348] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:46:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:46:19.999991 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75349-0684-432e-b387-514d285b07e4 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:20.000282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75349-0684-432e-b387-514d285b07e4 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:20.000561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75349-0684-432e-b387-514d285b07e4 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:20.001940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1173/2349] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:46:20.006779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc40bc-3216-4aeb-931d-4192c807a05f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:20.007077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc40bc-3216-4aeb-931d-4192c807a05f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:20.007392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc40bc-3216-4aeb-931d-4192c807a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:20.027018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-21dc40bc-3216-4aeb-931d-4192c807a05f None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:20.028349 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-21dc40bc-3216-4aeb-931d-4192c807a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:20.035455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1177/2350] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:20.047492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75349-0684-432e-b387-514d285b07e4 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:20.049150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-09a75349-0684-432e-b387-514d285b07e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:20.062016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75349-0684-432e-b387-514d285b07e4 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:20.065576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e22ba-60e0-4485-be69-65a5756ec397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:20.066197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e22ba-60e0-4485-be69-65a5756ec397 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:20.066476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e22ba-60e0-4485-be69-65a5756ec397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:20.066778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e22ba-60e0-4485-be69-65a5756ec397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:20.073574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e22ba-60e0-4485-be69-65a5756ec397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:20.074990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e22ba-60e0-4485-be69-65a5756ec397 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:20.083004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1174/2351] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:46:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:46:20.164266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ade9e-5f4d-4bb2-aa3d-a2cb625f90b3 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:20.164560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ade9e-5f4d-4bb2-aa3d-a2cb625f90b3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:20.164844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ade9e-5f4d-4bb2-aa3d-a2cb625f90b3 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:20.166428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1178/2352] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:46:20.172056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917937e-194a-47e9-afe0-7e9a45841279 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:20.172349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917937e-194a-47e9-afe0-7e9a45841279 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:20.172628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917937e-194a-47e9-afe0-7e9a45841279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:20.190949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6917937e-194a-47e9-afe0-7e9a45841279 None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:20.192174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6917937e-194a-47e9-afe0-7e9a45841279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:20.201486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1175/2353] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:20.212045 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ade9e-5f4d-4bb2-aa3d-a2cb625f90b3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:20.222899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ade9e-5f4d-4bb2-aa3d-a2cb625f90b3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:20.226583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:20.227252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:20.227542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:20.227821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:20.238025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:20.239483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:20.250699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1179/2354] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:46:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:46:21.038680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db091-ff9e-4011-8609-cc05b96d6f00 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:21.039346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db091-ff9e-4011-8609-cc05b96d6f00 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:21.039346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db091-ff9e-4011-8609-cc05b96d6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:21.058962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-342db091-ff9e-4011-8609-cc05b96d6f00 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:21.060185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-342db091-ff9e-4011-8609-cc05b96d6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:21.067512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1176/2355] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:46:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:21.079922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:21.091870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495341cc-c60c-49ee-8707-bf203b9c0c61 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:21.097602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:21.098601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:21.099040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:21.099419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:21.110066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:21.111719 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:21.121118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1180/2356] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:46:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:46:23.196957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76e5d5-8024-474e-8452-90eceb969dde None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:23.197912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76e5d5-8024-474e-8452-90eceb969dde None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:23.198356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76e5d5-8024-474e-8452-90eceb969dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:23.222457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-2c76e5d5-8024-474e-8452-90eceb969dde None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:23.224024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-2c76e5d5-8024-474e-8452-90eceb969dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:23.260845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1177/2357] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:46:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:23.271491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:23.314665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37ce6b-b592-4554-b307-1c11d0c9714e service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:23.329838 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:23.331011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:23.331545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:23.332020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:23.349635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:23.351282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:23.366356 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1181/2358] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:46:36.973842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:36.974398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:36.974398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:36.993056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:36.994401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:37.003122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1178/2359] 10.222.0.45 () {58 vars in 967 bytes} [Fri Apr 29 18:46:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:37.017474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:37.028235 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86924-00d9-4a12-b945-2e070e2b19ca service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:37.034306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:37.035073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:37.035467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:37.035747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:37.046490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:37.048861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:37.057905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1182/2360] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:46:38.942661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:38.955204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d29fdb-1cea-45e8-a501-39bde6ebf137 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:38.959728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:38.960588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:38.960864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:38.961133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] PATH_INFO: `/v3/users/7d6a22b1443f4034b14e5799a3718dc4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:38.962301 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6a22b1443f4034b14e5799a3718dc4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:38.964241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:39.008670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6a22b1443f4034b14e5799a3718dc4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.020800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6a22b1443f4034b14e5799a3718dc4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.027508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6a22b1443f4034b14e5799a3718dc4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.028127 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6a22b1443f4034b14e5799a3718dc4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.034740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-0beff4b1-0b77-4c29-96d7-9c4824407280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6a22b1443f4034b14e5799a3718dc4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.040480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1179/2361] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:46:38 2022] DELETE /identity/v3/users/7d6a22b1443f4034b14e5799a3718dc4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:46:39.224659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:39.236088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a19b-751b-4309-9703-6f4adbe0889b service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:39.293547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:39.294332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:39.294616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:39.294902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] PATH_INFO: `/v3/projects/908745be8c2247a08d9cfca95e7b8cd4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:39.296153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] RBAC: Authorizing `identity:delete_project(project_id=908745be8c2247a08d9cfca95e7b8cd4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:39.298563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:39.343420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908745be8c2247a08d9cfca95e7b8cd4', 'request_id': 'req-50f24eca-8b72-4931-aab6-a2601675994c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.350776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908745be8c2247a08d9cfca95e7b8cd4', 'request_id': 'req-50f24eca-8b72-4931-aab6-a2601675994c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.356516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908745be8c2247a08d9cfca95e7b8cd4', 'request_id': 'req-50f24eca-8b72-4931-aab6-a2601675994c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.368341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] The token cache is being invalidate because project 908745be8c2247a08d9cfca95e7b8cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:46:39.368623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.369266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:46:39.370942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1183/2362] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:46:39 2022] DELETE /identity/v3/projects/908745be8c2247a08d9cfca95e7b8cd4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:46:53.005441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:53.005888 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:53.005985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:53.023735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:46:53.024915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:53.076101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1180/2363] 10.222.0.45 () {58 vars in 967 bytes} [Fri Apr 29 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:46:53.089327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:46:53.090774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:46:53.156722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f24eca-8b72-4931-aab6-a2601675994c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:46:53.161650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:46:53.162293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:46:53.162576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:46:53.162855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:46:53.170690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:46:53.172291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:46:53.180471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1184/2364] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:47:47.408182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:47:47.409676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:47:47.462850 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04184a35-7341-46a0-a409-f1a44c040e17 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:47:47.466613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:47:47.467286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:47:47.467573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:47:47.467851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:47:47.470169 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:47:47.536668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:47:47.538097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660382-0342-453f-9bee-ad85b5caa11c service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:47:47.548783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1181/2365] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:47:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:47:51.027729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:47:51.029164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:47:51.040771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cab9d-50b9-4ab2-911c-0cd279992e22 service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:47:51.044302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:47:51.044931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:47:51.045212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:47:51.045487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:47:51.047273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:47:51.059913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:47:51.061309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:47:51.072567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1185/2366] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:47:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:02.785591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:02.786081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:02.786191 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:02.802505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] MFA Rules not processed for user `fa3948f301e84488b6c3f0a6dc069202`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:48:02.803715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:02.856042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1182/2367] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:48:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:48:03.098960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:03.107422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8be651-e41d-4143-96f4-30c23520a0b6 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:03.111566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:03.112431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:03.112715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:03.112995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:03.114920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:03.124491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:03.125906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:03.133869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1186/2368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:09.054238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:09.056839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:09.088082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1ddd8-b7e4-4013-804f-4075f87f255d None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:09.095515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:09.096187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:09.096533 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:09.096821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:09.098959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:09.112616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:09.114240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:09.125365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1183/2369] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:11.477041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:11.491156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74be8-ed1a-4124-aa18-72e99b62a2d8 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:11.496766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:11.497423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:11.497901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:11.498366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:11.500193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:11.562030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:11.563721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c943126-2938-42bf-8d6d-2e2d5ed5b693 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:11.573185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1187/2370] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:21.417689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:21.419203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:21.432571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2b66c-32b0-4047-ad83-16b90b3a806b service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:21.438223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:21.438977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:21.439386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:21.439766 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:21.441615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:21.498044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:21.499695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:21.509162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1184/2371] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:23.107624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:23.108102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:23.108218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:23.125295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] MFA Rules not processed for user `7f0abeff2be84d51854bd3231864669e`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:48:23.126487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:23.133305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1188/2372] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:48:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:48:23.424618 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:23.433837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b02b-d13f-46bf-b9fd-b1a846b5136a service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:23.437521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:23.438163 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:23.438450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:23.438732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:23.440574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:23.450418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:23.451897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d1d4-f22a-4c08-99e1-efb95fd002a1 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:23.460350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1185/2373] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:23.760528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:23.762073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:23.830965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55032f73-8cd8-49db-8652-03fed68620e6 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:23.835951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:23.836602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:23.836890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:23.837173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:23.838920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:23.850000 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:23.851609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:23.861218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1189/2374] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:48:32.036268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaad3b-4d53-4156-8cfa-7cd708ce0edf None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:32.036764 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaad3b-4d53-4156-8cfa-7cd708ce0edf None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:32.036861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaad3b-4d53-4156-8cfa-7cd708ce0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:32.053890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-26eaad3b-4d53-4156-8cfa-7cd708ce0edf None None] MFA Rules not processed for user `c9a4f5ac438741bcad2867f46c4dfaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:48:32.055068 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-26eaad3b-4d53-4156-8cfa-7cd708ce0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:32.061799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1186/2375] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:48:37.452500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:48:37.467333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9434-92a7-4d8b-977c-a85832ad3d91 service placement] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:48:37.472818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:48:37.473465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:48:37.473746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:48:37.474022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:48:37.475783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:48:37.487836 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:48:37.489396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea73a8-7bd7-4509-886a-fc17e028b757 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:48:37.499728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1190/2376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:48:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:49:07.403476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea05e41-52b0-4250-a023-f70aeaa5fac1 None None] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:07.404394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea05e41-52b0-4250-a023-f70aeaa5fac1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:07.404682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea05e41-52b0-4250-a023-f70aeaa5fac1 None None] PATH_INFO: `/` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:07.406606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1187/2377] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:49:07.416142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4489a2f-c3de-4ff5-9484-c66fc8e4c49e None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:07.416689 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4489a2f-c3de-4ff5-9484-c66fc8e4c49e None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:07.416796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4489a2f-c3de-4ff5-9484-c66fc8e4c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:07.435956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f4489a2f-c3de-4ff5-9484-c66fc8e4c49e None None] MFA Rules not processed for user `840dcc6108454d54ac3fde8bd2096665`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:49:07.437189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f4489a2f-c3de-4ff5-9484-c66fc8e4c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:07.444602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1191/2378] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:49:07.456505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea05e41-52b0-4250-a023-f70aeaa5fac1 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:49:07.468641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea05e41-52b0-4250-a023-f70aeaa5fac1 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:49:07.473197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208ed77-3680-45f8-b754-ac0c17d8b861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:49:07.473844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ed77-3680-45f8-b754-ac0c17d8b861 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:07.474130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ed77-3680-45f8-b754-ac0c17d8b861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:07.474412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ed77-3680-45f8-b754-ac0c17d8b861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:07.482121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ed77-3680-45f8-b754-ac0c17d8b861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:49:07.484242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ed77-3680-45f8-b754-ac0c17d8b861 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:49:07.492288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1188/2379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:49:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:49:07.573748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d1f7-fda2-4397-9b9f-00b9ea14b68a None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:07.574043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d1f7-fda2-4397-9b9f-00b9ea14b68a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:07.574323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d1f7-fda2-4397-9b9f-00b9ea14b68a None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:07.575747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1192/2380] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:49:07.580541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:07.580833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:07.581128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:07.599508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:49:07.600732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:07.610722 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1189/2381] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:49:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:49:07.620857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d1f7-fda2-4397-9b9f-00b9ea14b68a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:49:07.631939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d1f7-fda2-4397-9b9f-00b9ea14b68a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:49:07.635518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a3a7b-fb60-413b-a105-09bf9c112950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:49:07.636183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3a7b-fb60-413b-a105-09bf9c112950 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:07.636469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3a7b-fb60-413b-a105-09bf9c112950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:07.636749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3a7b-fb60-413b-a105-09bf9c112950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:07.647671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3a7b-fb60-413b-a105-09bf9c112950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:49:07.649094 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3a7b-fb60-413b-a105-09bf9c112950 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:49:07.660178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1193/2382] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:49:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:49:17.003741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:49:17.005177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:17.062983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c903-f1c9-4351-99e9-a78e9666806f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:49:17.066686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:49:17.067366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:17.067652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:17.067932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:17.069770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:17.127455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:49:17.128893 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:49:17.137650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1190/2383] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:49:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:49:22.925190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:22.925691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:22.925795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:22.943427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] MFA Rules not processed for user `aeea9d59c41341db8496a2c63d8655fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:49:22.944613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:22.951562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1194/2384] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:49:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:49:23.245789 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:49:23.254746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fb5ee-ad8d-44b3-810c-754355037150 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:49:23.258396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:49:23.259029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:23.259348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:23.259628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:23.261385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:23.270754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:49:23.272220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:49:23.280430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1191/2385] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:49:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:49:39.427799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:49:39.437692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d464d23-7f2a-4a94-805e-da22e2c6671d None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:49:39.441413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:49:39.442072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:39.442353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:39.442628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:39.444930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:39.457236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:49:39.458670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:49:39.468381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1195/2386] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:49:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:49:59.097677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:49:59.106024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23278c-2f04-4ae2-a814-72d3782d501a service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:49:59.110237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:49:59.110872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:49:59.111186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:49:59.111467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:49:59.113250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:49:59.173926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:49:59.175393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:49:59.184673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1192/2387] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:02.472202 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:02.474574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:02.491231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c68265-f77b-45c6-8e1d-472eddfe892f service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:02.495831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:02.496775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:02.497253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:02.497556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] PATH_INFO: `/v3/users/fa3948f301e84488b6c3f0a6dc069202` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:02.499583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3948f301e84488b6c3f0a6dc069202)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:02.501625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:02.552591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3948f301e84488b6c3f0a6dc069202'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.565064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3948f301e84488b6c3f0a6dc069202'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.572518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3948f301e84488b6c3f0a6dc069202'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.573157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3948f301e84488b6c3f0a6dc069202'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.573764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-04c8858b-9509-4328-b3c4-62c42ee6e9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3948f301e84488b6c3f0a6dc069202'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.586087 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1196/2388] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:02 2022] DELETE /identity/v3/users/fa3948f301e84488b6c3f0a6dc069202 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:02.762792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:02.773333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37f7d-c5ba-4458-957a-9c2fcdc0acca service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:02.839881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:02.840763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:02.841040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:02.841309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] PATH_INFO: `/v3/projects/619a903e035048f4bb5d9315cff91b7a` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:02.842498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] RBAC: Authorizing `identity:delete_project(project_id=619a903e035048f4bb5d9315cff91b7a)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:02.844473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:02.887039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619a903e035048f4bb5d9315cff91b7a', 'request_id': 'req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.894581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619a903e035048f4bb5d9315cff91b7a', 'request_id': 'req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.899742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619a903e035048f4bb5d9315cff91b7a', 'request_id': 'req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.910054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] The token cache is being invalidate because project 619a903e035048f4bb5d9315cff91b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:02.910338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.911017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a06ff26e-79df-4add-9cdf-bfb1b7b7279d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:02.912498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1193/2389] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:02 2022] DELETE /identity/v3/projects/619a903e035048f4bb5d9315cff91b7a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:02.917378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:02.917670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:02.917951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:02.936325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:02.937526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:02.993258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1197/2390] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:03.001158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.001451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.001723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.020098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:03.021288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:03.029481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1194/2391] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:03.033750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.043208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf25aa-9c24-44c2-8c50-c7a8ce7afaaa None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.047698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.048352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.048636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.048916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.049641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:50:03.049948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.051582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.063132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1198/2392] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:50:03.067098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.076044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d1feb-2631-4b3c-b519-652845894c71 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.081244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.081880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.082162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.082441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.083133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.085060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.118471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1195/2393] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:03 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:03.122568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.132843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2a0a9-3f5b-44b1-a9e0-297289645af4 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.186464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.187052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.187373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.187649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.188370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.190327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.210105 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1199/2394] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:03 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:03.214283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.224480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c916-0f31-4ff9-8caa-476568e2eec6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.228942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.229649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.229934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.230208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.230923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.233077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.242457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1196/2395] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:03.246116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.256379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf5d7-6d9d-4054-bf93-aa9184ab863c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.260986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f034c0-4c86-4770-8810-280cef8b4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.261637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f034c0-4c86-4770-8810-280cef8b4a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.261924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f034c0-4c86-4770-8810-280cef8b4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.262200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f034c0-4c86-4770-8810-280cef8b4a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.262925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f034c0-4c86-4770-8810-280cef8b4a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.264605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f034c0-4c86-4770-8810-280cef8b4a9f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.274340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1200/2396] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:03.278224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.287891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4c0f-16a8-462b-8166-73b763d1f601 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.292430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.293285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.293562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.293832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] PATH_INFO: `/v3/projects/2959b2133d0149c5870516c3359a6735/users/dc234cc4ae6a467eac429557bbf859ac/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.308872 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2959b2133d0149c5870516c3359a6735, user_id=dc234cc4ae6a467eac429557bbf859ac, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.312214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.325059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1197/2397] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:03 2022] PUT /identity/v3/projects/2959b2133d0149c5870516c3359a6735/users/dc234cc4ae6a467eac429557bbf859ac/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:03.334980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.335306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.335587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.361149 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] MFA Rules not processed for user `dc234cc4ae6a467eac429557bbf859ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:03.362333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:03.430390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1201/2398] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:03.441658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:03.443298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:03.515328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa292d-8280-4db3-879d-b9a478d4b7de admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:03.521208 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3a951-3d27-4ac8-94bb-307f158737d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:03.521882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a951-3d27-4ac8-94bb-307f158737d2 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:03.522165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a951-3d27-4ac8-94bb-307f158737d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:03.522465 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a951-3d27-4ac8-94bb-307f158737d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:03.530494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3a951-3d27-4ac8-94bb-307f158737d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:03.532102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3a951-3d27-4ac8-94bb-307f158737d2 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:03.540588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1198/2399] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:50:08.659242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:08.724639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79486e51-2e54-4741-8cf7-f0903de42701 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:08.729226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:08.730107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:08.730392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:08.730670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] PATH_INFO: `/v3/users/dc234cc4ae6a467eac429557bbf859ac` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:08.731895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc234cc4ae6a467eac429557bbf859ac)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:08.734495 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:08.777816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc234cc4ae6a467eac429557bbf859ac'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:08.789744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc234cc4ae6a467eac429557bbf859ac'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:08.796792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc234cc4ae6a467eac429557bbf859ac'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:08.797505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc234cc4ae6a467eac429557bbf859ac'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:08.798182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc234cc4ae6a467eac429557bbf859ac'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:08.809993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1202/2400] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:08 2022] DELETE /identity/v3/users/dc234cc4ae6a467eac429557bbf859ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:08.814466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:08.814956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:08.815054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:08.831535 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:08.832767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:08.888710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1199/2401] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:08.898435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:08.899874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:08.956404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7969031-adc5-43d4-8953-bbdf7efecd55 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:08.960040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b046c0-8916-4c46-b70e-5db3c904a3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:08.960685 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b046c0-8916-4c46-b70e-5db3c904a3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:08.960973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b046c0-8916-4c46-b70e-5db3c904a3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:08.961251 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b046c0-8916-4c46-b70e-5db3c904a3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:08.970652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b046c0-8916-4c46-b70e-5db3c904a3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:08.972116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b046c0-8916-4c46-b70e-5db3c904a3e6 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:08.981309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1203/2402] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:09.234392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.236040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:09.250079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ac966-10f3-4fc9-95c7-eba10bb76aa6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.255466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.256410 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.256690 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.256958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] PATH_INFO: `/v3/projects/2959b2133d0149c5870516c3359a6735` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.258129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2959b2133d0149c5870516c3359a6735)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.260108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.304928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2959b2133d0149c5870516c3359a6735', 'request_id': 'req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:09.312617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2959b2133d0149c5870516c3359a6735', 'request_id': 'req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:09.318121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2959b2133d0149c5870516c3359a6735', 'request_id': 'req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:09.328786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] The token cache is being invalidate because project 2959b2133d0149c5870516c3359a6735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:09.329014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:09.329645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-34a6eb18-4250-43cb-8d7a-d6e2fca8308a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:09.331204 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1200/2403] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:09 2022] DELETE /identity/v3/projects/2959b2133d0149c5870516c3359a6735 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:09.336585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.336937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.337279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.359872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:09.361075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:09.417751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1204/2404] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:09.426750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.427038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.427350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.446206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:09.447454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:09.457866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1201/2405] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:50:09.461896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.472691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967c1eb-50a2-45c2-9a5c-ef245195e7f2 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.477216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.477880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.478155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.478436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.479218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:50:09.479549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.481132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.492910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1205/2406] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:50:09.497558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.510581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a007d-2765-4aff-b40a-8540427d0b6a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.515336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.515981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.516258 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.516529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.517211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.519381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.548198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1202/2407] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:09 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:09.549416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.559509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a9ef-45a7-4b10-90e8-2b34ee2ca139 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.614339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.615018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.615333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.615613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.616302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.618218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.636717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1206/2408] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:09 2022] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:09.640971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.651285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea97b3d-2007-48ec-aa27-f5ec39e5887f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.656475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.657156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.657460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.657736 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.658471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.660223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.670844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1203/2409] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:09.674579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.684488 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104677-1f4f-4afb-8f18-517139e22bcf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.689108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d41694-b60a-424c-af2f-b8fecd8e2d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.689764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d41694-b60a-424c-af2f-b8fecd8e2d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.690056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d41694-b60a-424c-af2f-b8fecd8e2d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.690449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d41694-b60a-424c-af2f-b8fecd8e2d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.691255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d41694-b60a-424c-af2f-b8fecd8e2d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.692886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d41694-b60a-424c-af2f-b8fecd8e2d4d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.702533 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1207/2410] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:09.706433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.716168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95712a3-cbb0-431a-b6a0-4df761dea615 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.721284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.722145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.722423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.722695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] PATH_INFO: `/v3/projects/be2dc9f7787542c280d8aaa32c0c4549/users/fdbe0c238a274db7817a396b409e1f6a/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.739670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2dc9f7787542c280d8aaa32c0c4549, user_id=fdbe0c238a274db7817a396b409e1f6a, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.742992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.757804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1204/2411] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:09 2022] PUT /identity/v3/projects/be2dc9f7787542c280d8aaa32c0c4549/users/fdbe0c238a274db7817a396b409e1f6a/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:09.763179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec91a-8e1f-4f1d-aec2-b7e6b5c586ed None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.763476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec91a-8e1f-4f1d-aec2-b7e6b5c586ed None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.763933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec91a-8e1f-4f1d-aec2-b7e6b5c586ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.783843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e94ec91a-8e1f-4f1d-aec2-b7e6b5c586ed None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:09.785049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e94ec91a-8e1f-4f1d-aec2-b7e6b5c586ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:09.841346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1208/2412] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:09.851394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:09.853100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:09.907748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef874ff-12b9-4ff6-9841-4b702bf0f3d8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:09.911350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:09.911997 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:09.912304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:09.912591 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:09.921668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:09.923616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:09.935487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1205/2413] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:50:10.536656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.536952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.537234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.563427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] MFA Rules not processed for user `fdbe0c238a274db7817a396b409e1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:10.564640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:10.631982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1209/2414] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:10.633336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:10.643408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce59ce-e785-44a4-ba6a-cb79e3711ce9 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:10.648252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:10.648899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.649183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.649459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.650144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:10.652093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:10.681756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1206/2415] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:10 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:50:10.682870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:10.693653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d272-1358-450b-9889-cc3632ba61ce None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:10.748431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:10.749106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.749391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.749670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.750366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:10.752318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:10.771421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1210/2416] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:10 2022] POST /identity/v3/users => generated 308 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:50:10.775527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:10.786014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001a21-932a-443c-a797-066d3d44ab68 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:10.790493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:10.791168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.791457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.791724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.792440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:10.794107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:10.805274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1207/2417] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:10.809331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:10.818994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ba6d7-f324-4b0d-9942-cf68b14c6449 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:10.823578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:10.824455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.824741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.825035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] PATH_INFO: `/v3/projects/be300cb2afd9446bbf7d877bc5152697/users/af509de5fe9f4fc98e9af3bfeadb0690/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.839543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be300cb2afd9446bbf7d877bc5152697, user_id=af509de5fe9f4fc98e9af3bfeadb0690, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:10.842810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:10.855462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1211/2418] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:10 2022] PUT /identity/v3/projects/be300cb2afd9446bbf7d877bc5152697/users/af509de5fe9f4fc98e9af3bfeadb0690/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:10.859336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:10.869047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a022f1-80b1-4cf2-b291-4331cd7379b4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:10.922371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aea0b2-1dd4-4b9c-b01c-325c31096ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:10.923025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aea0b2-1dd4-4b9c-b01c-325c31096ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.923352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aea0b2-1dd4-4b9c-b01c-325c31096ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.923629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aea0b2-1dd4-4b9c-b01c-325c31096ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.924344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aea0b2-1dd4-4b9c-b01c-325c31096ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:10.925936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aea0b2-1dd4-4b9c-b01c-325c31096ae7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:10.935232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1208/2419] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:10.939500 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:10.949428 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d4e03-3606-4ed4-80aa-740c52488ed9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:10.954501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:10.955405 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:10.955690 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:10.955967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] PATH_INFO: `/v3/projects/be300cb2afd9446bbf7d877bc5152697/users/af509de5fe9f4fc98e9af3bfeadb0690/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:10.957893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be300cb2afd9446bbf7d877bc5152697, user_id=af509de5fe9f4fc98e9af3bfeadb0690, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:10.960596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:10.970910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1212/2420] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:10 2022] PUT /identity/v3/projects/be300cb2afd9446bbf7d877bc5152697/users/af509de5fe9f4fc98e9af3bfeadb0690/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:11.777032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:11.777400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:11.777796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:11.805693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] MFA Rules not processed for user `af509de5fe9f4fc98e9af3bfeadb0690`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:11.807032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:11.872273 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1209/2421] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:12.839299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:12.898515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674c818-bdcb-4daa-bdf8-ad81491a8d74 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:12.903231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:12.904089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:12.904377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:12.904651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] PATH_INFO: `/v3/users/fdbe0c238a274db7817a396b409e1f6a` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:12.905825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbe0c238a274db7817a396b409e1f6a)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:12.907785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:12.953451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbe0c238a274db7817a396b409e1f6a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:12.964734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbe0c238a274db7817a396b409e1f6a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:12.971891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbe0c238a274db7817a396b409e1f6a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:12.972539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbe0c238a274db7817a396b409e1f6a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:12.973144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbe0c238a274db7817a396b409e1f6a'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:12.985600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1213/2422] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:12 2022] DELETE /identity/v3/users/fdbe0c238a274db7817a396b409e1f6a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:13.151778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:13.164117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e9f4-20de-4589-8ed3-aedca207c172 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:13.219851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:13.220746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.221030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.221314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] PATH_INFO: `/v3/projects/be2dc9f7787542c280d8aaa32c0c4549` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.222524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2dc9f7787542c280d8aaa32c0c4549)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:13.224488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:13.267252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2dc9f7787542c280d8aaa32c0c4549', 'request_id': 'req-26391e84-4378-4fff-afd4-afc5f7918136'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.274296 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2dc9f7787542c280d8aaa32c0c4549', 'request_id': 'req-26391e84-4378-4fff-afd4-afc5f7918136'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.280065 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2dc9f7787542c280d8aaa32c0c4549', 'request_id': 'req-26391e84-4378-4fff-afd4-afc5f7918136'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.290487 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] The token cache is being invalidate because project be2dc9f7787542c280d8aaa32c0c4549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:13.290772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.291414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.292952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1210/2423] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:13 2022] DELETE /identity/v3/projects/be2dc9f7787542c280d8aaa32c0c4549 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:13.297540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:13.299171 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:13.312027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3e095-084d-47b0-9035-0dd4d6c83bea admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:13.366812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:13.367713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.367997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.368266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] PATH_INFO: `/v3/users/af509de5fe9f4fc98e9af3bfeadb0690` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.369445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af509de5fe9f4fc98e9af3bfeadb0690)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:13.371396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:13.416694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af509de5fe9f4fc98e9af3bfeadb0690'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.428248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af509de5fe9f4fc98e9af3bfeadb0690'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.434992 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af509de5fe9f4fc98e9af3bfeadb0690'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.435714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af509de5fe9f4fc98e9af3bfeadb0690'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.436255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2ae46cba-35e7-43fe-8a76-ba2e217f77c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af509de5fe9f4fc98e9af3bfeadb0690'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.447922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1214/2424] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:13 2022] DELETE /identity/v3/users/af509de5fe9f4fc98e9af3bfeadb0690 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:13.612817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:13.614290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:13.631576 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391e84-4378-4fff-afd4-afc5f7918136 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:13.686889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:13.687852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.688143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.688414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] PATH_INFO: `/v3/projects/be300cb2afd9446bbf7d877bc5152697` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.689614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be300cb2afd9446bbf7d877bc5152697)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:13.691598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:13.735279 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be300cb2afd9446bbf7d877bc5152697', 'request_id': 'req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.741862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be300cb2afd9446bbf7d877bc5152697', 'request_id': 'req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.747022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be300cb2afd9446bbf7d877bc5152697', 'request_id': 'req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.757349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] The token cache is being invalidate because project be300cb2afd9446bbf7d877bc5152697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:13.757635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.758251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b5ad516c-64f3-4d9a-b7cb-fa39cbc29584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:13.759814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1211/2425] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:13 2022] DELETE /identity/v3/projects/be300cb2afd9446bbf7d877bc5152697 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:13.765156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.765445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.765722 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.783741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:13.784952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:13.841111 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1215/2426] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:13.849532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.849822 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.850099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.867556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:13.868737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:13.876423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1212/2427] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:13.880386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:13.890621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9330-cc74-4dae-8c21-cbf6c7fdb03f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:13.895450 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:13.896106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.896392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.896672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.897399 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:50:13.897710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:13.899361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:13.911178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1216/2428] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:50:13.915243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:13.924253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5cf6d-ed67-4056-a3d3-8bbbfdbe8950 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:13.928817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:13.929451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:13.929737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:13.930011 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:13.930685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:13.932609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:13.956974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1213/2429] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:13 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:13.961060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:13.971886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb424ef-8bdd-450c-9666-dfbac95c0ebc admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.026609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.027307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.027594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.027904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.028556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.030463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.048165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1217/2430] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:13 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:14.052317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.062858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aaa9d-b801-4cf2-bba6-79d4fd2f483d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.067486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.068137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.068425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.068706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.069433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.071053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.081589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1214/2431] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:14.085276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.094918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e74a6-cbfa-4682-adcf-2b7422195423 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.099454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5cd5-d99f-4f14-8aa9-a70a84f671e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.100096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5cd5-d99f-4f14-8aa9-a70a84f671e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.100380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5cd5-d99f-4f14-8aa9-a70a84f671e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.100657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5cd5-d99f-4f14-8aa9-a70a84f671e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.101377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5cd5-d99f-4f14-8aa9-a70a84f671e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.102973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa5cd5-d99f-4f14-8aa9-a70a84f671e2 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.112720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1218/2432] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:50:14.116723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.126841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467b53-1673-4bae-ad2a-78a66c47b304 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.131267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.132124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.132403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.132675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] PATH_INFO: `/v3/projects/eefad5006df345df8e0e5f430eccbd5a/users/9fa8f16fb22243fdbf4226b9093cda16/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.147340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefad5006df345df8e0e5f430eccbd5a, user_id=9fa8f16fb22243fdbf4226b9093cda16, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.149973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.162201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1215/2433] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:14 2022] PUT /identity/v3/projects/eefad5006df345df8e0e5f430eccbd5a/users/9fa8f16fb22243fdbf4226b9093cda16/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:14.172365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.172656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.172936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.199301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] MFA Rules not processed for user `9fa8f16fb22243fdbf4226b9093cda16`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:14.200505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:14.261954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1219/2434] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:14.266918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.325381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cf25-f71c-43bf-97db-aaeaa573aad6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.330546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.331221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.331511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.331790 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.332464 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.334396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.358272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1216/2435] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:14 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:14.362139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.372583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fe3df-e961-4986-b8a4-902b08ac3802 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.427336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.427927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.428209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.428484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.429165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.431065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.450637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1220/2436] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:14 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:14.454594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.464838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1992b-9cf3-4c6f-83ea-d487a59d7045 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.469429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.470084 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.470367 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.470643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.471414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.473025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.485214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1217/2437] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:50:14.489499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.500301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ffd61-9857-40af-9331-ed288b0937db admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.505068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.505988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.506280 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.506560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] PATH_INFO: `/v3/projects/4fece84d561346caa4e9da22375ae9ef/users/15657b99eeab4565aa5b4554f2f18ac3/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.521403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fece84d561346caa4e9da22375ae9ef, user_id=15657b99eeab4565aa5b4554f2f18ac3, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.524129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.536427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1221/2438] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:14 2022] PUT /identity/v3/projects/4fece84d561346caa4e9da22375ae9ef/users/15657b99eeab4565aa5b4554f2f18ac3/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:14.540424 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.550633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab4211-1219-4fb4-b4dd-8208f0dabad3 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.602562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b006-d67c-4791-960f-000de2ce54c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.603248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b006-d67c-4791-960f-000de2ce54c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.603531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b006-d67c-4791-960f-000de2ce54c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.603804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b006-d67c-4791-960f-000de2ce54c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.604517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b006-d67c-4791-960f-000de2ce54c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.606188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b006-d67c-4791-960f-000de2ce54c9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.616463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1218/2439] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:14.620647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.631424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0811-fb60-46e8-8bbd-6c7b427c63ea admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.635970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.636846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.637129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.637404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] PATH_INFO: `/v3/projects/4fece84d561346caa4e9da22375ae9ef/users/15657b99eeab4565aa5b4554f2f18ac3/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.639411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fece84d561346caa4e9da22375ae9ef, user_id=15657b99eeab4565aa5b4554f2f18ac3, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.642070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.652102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1222/2440] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:14 2022] PUT /identity/v3/projects/4fece84d561346caa4e9da22375ae9ef/users/15657b99eeab4565aa5b4554f2f18ac3/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:14.663259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.663552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.663834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.689949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] MFA Rules not processed for user `15657b99eeab4565aa5b4554f2f18ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:14.691086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:14.754246 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1219/2441] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:50:14.765595 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:14.767309 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:14.822175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9c8d2-6fb8-426e-bfc1-11c05b4776c8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:14.826065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1adf-8054-4488-8717-c5d684a856c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:14.826751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1adf-8054-4488-8717-c5d684a856c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:14.827043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1adf-8054-4488-8717-c5d684a856c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:14.827358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1adf-8054-4488-8717-c5d684a856c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:14.839741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1adf-8054-4488-8717-c5d684a856c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:14.842215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1adf-8054-4488-8717-c5d684a856c0 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:14.852928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1223/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:15.209506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:15.267799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090f21-9ff5-422b-bc5c-c5c8764adce9 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:15.272495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:15.273350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:15.273626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:15.273898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] PATH_INFO: `/v3/users/9fa8f16fb22243fdbf4226b9093cda16` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:15.275045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa8f16fb22243fdbf4226b9093cda16)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:15.277020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:15.320463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa8f16fb22243fdbf4226b9093cda16'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.331390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa8f16fb22243fdbf4226b9093cda16'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.338124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa8f16fb22243fdbf4226b9093cda16'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.338756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa8f16fb22243fdbf4226b9093cda16'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.345229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa8f16fb22243fdbf4226b9093cda16'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.350785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1220/2443] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:15 2022] DELETE /identity/v3/users/9fa8f16fb22243fdbf4226b9093cda16 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:15.355252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:15.355549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:15.355859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:15.373899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:15.375086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:15.432774 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1224/2444] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:15.443095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:15.444570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:15.499462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b9e08-cfb6-458c-8c1c-0645ed7cd7a4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:15.503059 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:15.503725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:15.504010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:15.504288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:15.513406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:15.515861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:15.527150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1221/2445] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:50:15.781154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:15.782666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:15.795341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455657c-4f25-4ba6-987a-70bbaced695b None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:15.800062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:15.800934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:15.801366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:15.801622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] PATH_INFO: `/v3/projects/eefad5006df345df8e0e5f430eccbd5a` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:15.802659 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefad5006df345df8e0e5f430eccbd5a)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:15.804610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:15.849611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefad5006df345df8e0e5f430eccbd5a', 'request_id': 'req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.856817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefad5006df345df8e0e5f430eccbd5a', 'request_id': 'req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.862281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefad5006df345df8e0e5f430eccbd5a', 'request_id': 'req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.873143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] The token cache is being invalidate because project eefad5006df345df8e0e5f430eccbd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:15.873435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.874073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:15.875677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1225/2446] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:15 2022] DELETE /identity/v3/projects/eefad5006df345df8e0e5f430eccbd5a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:15.879628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:15.889498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70eebc-96f0-4930-a4da-fc09e63e3556 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:15.943315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:15.944175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:15.944457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:15.944729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] PATH_INFO: `/v3/users/15657b99eeab4565aa5b4554f2f18ac3` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:15.945890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15657b99eeab4565aa5b4554f2f18ac3)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:15.947867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:15.991032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15657b99eeab4565aa5b4554f2f18ac3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.002389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15657b99eeab4565aa5b4554f2f18ac3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.009188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15657b99eeab4565aa5b4554f2f18ac3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.009808 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15657b99eeab4565aa5b4554f2f18ac3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.016956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-822ca04f-ae36-4162-82e3-ff4f3b91d216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15657b99eeab4565aa5b4554f2f18ac3'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.022907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1222/2447] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:15 2022] DELETE /identity/v3/users/15657b99eeab4565aa5b4554f2f18ac3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:16.281480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.283055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:16.297807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c9e8e-25c8-4097-96f9-eb8a1b40f18f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.353274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.354138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.354451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.354727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] PATH_INFO: `/v3/projects/4fece84d561346caa4e9da22375ae9ef` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.355937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fece84d561346caa4e9da22375ae9ef)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.357843 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.403806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fece84d561346caa4e9da22375ae9ef', 'request_id': 'req-64e77d92-e599-4ceb-a80d-d075ac83738f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.411129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fece84d561346caa4e9da22375ae9ef', 'request_id': 'req-64e77d92-e599-4ceb-a80d-d075ac83738f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.416494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fece84d561346caa4e9da22375ae9ef', 'request_id': 'req-64e77d92-e599-4ceb-a80d-d075ac83738f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.427155 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] The token cache is being invalidate because project 4fece84d561346caa4e9da22375ae9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:16.427446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.428077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-64e77d92-e599-4ceb-a80d-d075ac83738f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:16.429608 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1226/2448] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:16 2022] DELETE /identity/v3/projects/4fece84d561346caa4e9da22375ae9ef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:16.434920 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.435915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.436050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.453847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:16.455039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:16.517974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1223/2449] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:50:16.525953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.526181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.526463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.544254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:16.545474 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:16.553204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1227/2450] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:16.557462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.567335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44c02e-bac8-4e87-8de7-2490fffeb149 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.571774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.572417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.572696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.572969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.573686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:50:16.573992 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.575620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.587079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1224/2451] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:50:16.591168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.600228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850f1f6-bc1b-446c-a385-0b6834f60b95 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.604870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.605518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.605802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.606086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.606784 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.609242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.633896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1228/2452] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:16 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:16.637660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.647693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a5f7-6036-49b5-a00b-b58758bc9f74 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.700819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.701478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.701761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.702035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.702765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.704847 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.722935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1225/2453] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:16 2022] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:50:16.726928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.737436 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6de6-88e3-4f13-871f-9ca281f7e89e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.741978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.742629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.742911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.743223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.743944 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.745525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.756103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1229/2454] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:50:16.759907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.769635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027eb56-5e59-4431-8476-252b96286f5b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.774131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffa5b2-2df5-4db6-a820-863ff3efb751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.774771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa5b2-2df5-4db6-a820-863ff3efb751 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.775056 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa5b2-2df5-4db6-a820-863ff3efb751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.775373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa5b2-2df5-4db6-a820-863ff3efb751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.776137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffa5b2-2df5-4db6-a820-863ff3efb751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.777662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffa5b2-2df5-4db6-a820-863ff3efb751 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.787775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1226/2455] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:16.791604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:16.801680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55276307-8ea3-4440-b81b-5e3a84c74fa3 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:16.806497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:16.808119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.808457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.808670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] PATH_INFO: `/v3/projects/d454bbc1d34445c2ac150d34f3225f4f/users/c7cae064ecf44872a8f29afe2a970013/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.825173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d454bbc1d34445c2ac150d34f3225f4f, user_id=c7cae064ecf44872a8f29afe2a970013, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:16.827888 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:16.840078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1230/2456] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:16 2022] PUT /identity/v3/projects/d454bbc1d34445c2ac150d34f3225f4f/users/c7cae064ecf44872a8f29afe2a970013/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:16.850082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:16.850372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:16.850653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:16.878060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] MFA Rules not processed for user `c7cae064ecf44872a8f29afe2a970013`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:16.879292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:16.939885 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1227/2457] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:16.944359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.002973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f4bf-d6b6-4158-92c5-5f633329e3eb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.007660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.008313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.008596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.008873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.009567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.011518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.037709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1231/2458] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:16 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:17.041745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.052745 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d153ae-3975-4619-922c-96c3551f6b56 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.106295 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.107805 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.108093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.108373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.109405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.111479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.133432 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1228/2459] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:17 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:17.137512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.147811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c632a-a8d1-4fa2-a43c-2b9cacd2f016 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.152275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.152928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.153213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.153489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.154703 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.156308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.166351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1232/2460] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:17.170912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.180810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3643e83-cb7c-4113-b048-f6b35ebf42d7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.185380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.186237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.186521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.186797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] PATH_INFO: `/v3/projects/c87f27c0535a4f5d94df3c6194be3e4f/users/4c183ee2a69e45b98a5655d2da535bac/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.200919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87f27c0535a4f5d94df3c6194be3e4f, user_id=4c183ee2a69e45b98a5655d2da535bac, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.203625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.215799 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1229/2461] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:17 2022] PUT /identity/v3/projects/c87f27c0535a4f5d94df3c6194be3e4f/users/4c183ee2a69e45b98a5655d2da535bac/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:17.220505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.230156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b1767-05c8-4d27-ba8e-75895878cc40 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.284032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f9593-8faf-471f-95d1-57aeac95663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.284698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f9593-8faf-471f-95d1-57aeac95663e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.284985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f9593-8faf-471f-95d1-57aeac95663e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.285262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f9593-8faf-471f-95d1-57aeac95663e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.285978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f9593-8faf-471f-95d1-57aeac95663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.287594 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f9593-8faf-471f-95d1-57aeac95663e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.297540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1233/2462] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:17.301653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.311941 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1ff8f-bbe9-43fa-b578-7bc21ef11ed8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.316555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.317418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.317700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.317977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] PATH_INFO: `/v3/projects/c87f27c0535a4f5d94df3c6194be3e4f/users/4c183ee2a69e45b98a5655d2da535bac/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.319969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87f27c0535a4f5d94df3c6194be3e4f, user_id=4c183ee2a69e45b98a5655d2da535bac, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.322603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.332865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1230/2463] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:17 2022] PUT /identity/v3/projects/c87f27c0535a4f5d94df3c6194be3e4f/users/4c183ee2a69e45b98a5655d2da535bac/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:17.344522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.344814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.345095 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.370052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] MFA Rules not processed for user `4c183ee2a69e45b98a5655d2da535bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:17.371277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:17.440460 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1234/2464] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:17.451685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.453824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:17.508821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb276d4-36f9-4e57-a1f3-756a1c332213 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.512486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.513126 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.513899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.514181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.523245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.524677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.536251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1231/2465] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:17.605361 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:17.614819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e06ab-4b6d-4232-bf20-a2130bf3f51f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:17.618370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e86f3-92bb-4d56-9f56-bd8483c5c71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:17.619007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e86f3-92bb-4d56-9f56-bd8483c5c71f service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:17.619329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e86f3-92bb-4d56-9f56-bd8483c5c71f service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:17.619605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e86f3-92bb-4d56-9f56-bd8483c5c71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:17.674282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e86f3-92bb-4d56-9f56-bd8483c5c71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:17.675748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e86f3-92bb-4d56-9f56-bd8483c5c71f service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:17.684205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1235/2466] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:24.515919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:24.576009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3259-61eb-4dd8-9902-0652235e07d9 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:24.580580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:24.581442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:24.581724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:24.581999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] PATH_INFO: `/v3/users/c7cae064ecf44872a8f29afe2a970013` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:24.583198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cae064ecf44872a8f29afe2a970013)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:24.585129 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:24.629467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cae064ecf44872a8f29afe2a970013'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:24.640401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cae064ecf44872a8f29afe2a970013'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:24.647382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cae064ecf44872a8f29afe2a970013'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:24.647981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cae064ecf44872a8f29afe2a970013'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:24.654455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cae064ecf44872a8f29afe2a970013'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:24.660680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1232/2467] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:24 2022] DELETE /identity/v3/users/c7cae064ecf44872a8f29afe2a970013 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:24.665107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:24.665570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:24.665665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:24.682738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:24.683972 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:24.740389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1236/2468] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:24.749914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:24.751259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:24.805660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5890-5862-4026-b7b2-abc4641866e7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:24.809412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:24.810054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:24.810336 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:24.810612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:24.819617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:24.821054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:24.830854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1233/2469] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:25.079421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:25.080884 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:25.092554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a679-171c-4b02-bae6-1febb6a4e0b1 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:25.097965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:25.098835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.099142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.099434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] PATH_INFO: `/v3/projects/d454bbc1d34445c2ac150d34f3225f4f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.100643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d454bbc1d34445c2ac150d34f3225f4f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:25.102565 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:25.148671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd454bbc1d34445c2ac150d34f3225f4f', 'request_id': 'req-d773fa98-7594-4ff2-9262-ea26aca84708'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.155729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd454bbc1d34445c2ac150d34f3225f4f', 'request_id': 'req-d773fa98-7594-4ff2-9262-ea26aca84708'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.161819 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd454bbc1d34445c2ac150d34f3225f4f', 'request_id': 'req-d773fa98-7594-4ff2-9262-ea26aca84708'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.172650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] The token cache is being invalidate because project d454bbc1d34445c2ac150d34f3225f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:25.172938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.173573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.175314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1237/2470] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:25 2022] DELETE /identity/v3/projects/d454bbc1d34445c2ac150d34f3225f4f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:25.179449 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:25.189511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48cf0d-9d86-45a7-8d31-d10f02dc883c service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:25.243004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:25.243911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.244192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.244468 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] PATH_INFO: `/v3/users/4c183ee2a69e45b98a5655d2da535bac` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.245623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c183ee2a69e45b98a5655d2da535bac)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:25.247573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:25.290833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c183ee2a69e45b98a5655d2da535bac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.302061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c183ee2a69e45b98a5655d2da535bac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.309486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c183ee2a69e45b98a5655d2da535bac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.310188 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c183ee2a69e45b98a5655d2da535bac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.317254 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c79865eb-5567-4790-acd4-13b3a54b6580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c183ee2a69e45b98a5655d2da535bac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.322945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1234/2471] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:25 2022] DELETE /identity/v3/users/4c183ee2a69e45b98a5655d2da535bac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:25.591913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:25.593355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:25.607740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773fa98-7594-4ff2-9262-ea26aca84708 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:25.664983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:25.665844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.666448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.666448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] PATH_INFO: `/v3/projects/c87f27c0535a4f5d94df3c6194be3e4f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.667567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87f27c0535a4f5d94df3c6194be3e4f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:25.669463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:25.713756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87f27c0535a4f5d94df3c6194be3e4f', 'request_id': 'req-57f3cc9c-0a78-433c-89c9-6c39c250675c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.721541 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87f27c0535a4f5d94df3c6194be3e4f', 'request_id': 'req-57f3cc9c-0a78-433c-89c9-6c39c250675c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.726907 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87f27c0535a4f5d94df3c6194be3e4f', 'request_id': 'req-57f3cc9c-0a78-433c-89c9-6c39c250675c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.738178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] The token cache is being invalidate because project c87f27c0535a4f5d94df3c6194be3e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:25.738470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.739139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57f3cc9c-0a78-433c-89c9-6c39c250675c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:25.740696 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1238/2472] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:25 2022] DELETE /identity/v3/projects/c87f27c0535a4f5d94df3c6194be3e4f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:25.745702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.746220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.746395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.763908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:25.765096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:25.821426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1235/2473] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:25.829233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.829551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.829831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.847534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:25.848721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:25.856556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1239/2474] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:25.860904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:25.870398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538d49e-ae82-4934-9420-43e55abc70f8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:25.874839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:25.876328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.876609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.876882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.877599 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:50:25.877909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:25.879545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:25.890400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1236/2475] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:50:25.894749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:25.903820 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599f6df-e755-4e70-adcf-46cd92a2c445 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:25.909001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:25.909647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:25.909933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:25.910241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:25.910966 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:25.912915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:25.937285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1240/2476] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:25 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:25.941225 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:25.950830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd166df-66cd-4a62-bb98-b5f1a7f16976 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.004184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.004845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.005132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.005413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.006110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.008103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.027430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1237/2477] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:25 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:50:26.032413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.042591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477d2a9-8582-42df-a536-195eecd5983f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.047874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.048537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.048828 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.049107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.049835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.051470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.061519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1241/2478] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:26.065202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.074749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1da00-875a-4e16-85d0-8fce0fd45dda admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.079325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ab030-4d1d-42a6-b29d-1cb41165854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.079978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab030-4d1d-42a6-b29d-1cb41165854f admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.080262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab030-4d1d-42a6-b29d-1cb41165854f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.080538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab030-4d1d-42a6-b29d-1cb41165854f admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.081253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ab030-4d1d-42a6-b29d-1cb41165854f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.082857 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ab030-4d1d-42a6-b29d-1cb41165854f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.092192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1238/2479] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:26.096480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.106528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f25f-006e-476a-85e2-acfeddb34241 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.111671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.112542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.112824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.113101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] PATH_INFO: `/v3/projects/e9126d8dbfac42fb9341e648aff9cb9f/users/47ee160fd23b47489bb9d484fcc4221c/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.127222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9126d8dbfac42fb9341e648aff9cb9f, user_id=47ee160fd23b47489bb9d484fcc4221c, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.129859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.142085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1242/2480] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:26 2022] PUT /identity/v3/projects/e9126d8dbfac42fb9341e648aff9cb9f/users/47ee160fd23b47489bb9d484fcc4221c/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:26.152469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.152765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.153045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.180825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] MFA Rules not processed for user `47ee160fd23b47489bb9d484fcc4221c`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:26.182032 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:26.243471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1239/2481] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:26.248021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.306752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fcf78-e6fa-42f9-ac86-7a94dc4941cf admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.311330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.311972 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.312255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.312532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.313207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.315103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.339756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1243/2482] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:26 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:26.343152 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.353998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79622e6b-54d9-4bd2-b6cb-7f8463072893 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.408797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.409388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.409670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.409947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.410624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.412598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.431037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1240/2483] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:26 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:26.434932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.445229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9d47-e2d5-4ee2-9615-86194cdc5915 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.449766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.450417 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.450721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.450980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.451891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.453982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.464142 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1244/2484] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:26.468194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.478500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c14d-9e76-4210-aa67-008c20f694ab admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.483081 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.483980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.484266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.484545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] PATH_INFO: `/v3/projects/8b5f3a6f396f4651a132225a779cf783/users/54d45f59c7fb4f2a81b942dba69a575d/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.498714 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5f3a6f396f4651a132225a779cf783, user_id=54d45f59c7fb4f2a81b942dba69a575d, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.501408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.515201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1241/2485] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:26 2022] PUT /identity/v3/projects/8b5f3a6f396f4651a132225a779cf783/users/54d45f59c7fb4f2a81b942dba69a575d/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:26.519954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.529624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39a5ea-d925-411e-8aea-7aa6cc4a0ea1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.586398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eaa7b-1df3-4245-9365-fe5616700cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.587069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eaa7b-1df3-4245-9365-fe5616700cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.587391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eaa7b-1df3-4245-9365-fe5616700cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.587673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eaa7b-1df3-4245-9365-fe5616700cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.588398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eaa7b-1df3-4245-9365-fe5616700cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.589990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eaa7b-1df3-4245-9365-fe5616700cd9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.599987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1245/2486] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:26.604067 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.614176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b9e3-33c7-4fa5-b68c-ba6b4d3b41b8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.618684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.619588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.619868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.620140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] PATH_INFO: `/v3/projects/8b5f3a6f396f4651a132225a779cf783/users/54d45f59c7fb4f2a81b942dba69a575d/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.622096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5f3a6f396f4651a132225a779cf783, user_id=54d45f59c7fb4f2a81b942dba69a575d, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.624786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.634621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1242/2487] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:26 2022] PUT /identity/v3/projects/8b5f3a6f396f4651a132225a779cf783/users/54d45f59c7fb4f2a81b942dba69a575d/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:26.646342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.646639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.646925 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.672871 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] MFA Rules not processed for user `54d45f59c7fb4f2a81b942dba69a575d`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:26.674012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:26.738420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1246/2488] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:26.749091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:26.751488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:26.806018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d129017-cfe3-4715-a010-6f1ae10990cf admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:26.809633 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:26.810272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:26.810559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:26.810840 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:26.864131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:26.865563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:26.874238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1243/2489] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:29.387875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:29.397856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb0be2-2370-4b2c-a4c8-dda089c7b980 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:29.401476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e078fb-9dfd-45b5-8cf2-ba0b61975404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:29.402147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e078fb-9dfd-45b5-8cf2-ba0b61975404 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:29.402431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e078fb-9dfd-45b5-8cf2-ba0b61975404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:29.402709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e078fb-9dfd-45b5-8cf2-ba0b61975404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:29.412057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e078fb-9dfd-45b5-8cf2-ba0b61975404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:29.413468 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e078fb-9dfd-45b5-8cf2-ba0b61975404 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:29.422654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1247/2490] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:41.711666 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:41.770103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60a9d-cabd-4c0b-bed1-314cd632c86c service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:41.774470 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:41.775347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:41.775629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:41.775906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] PATH_INFO: `/v3/users/47ee160fd23b47489bb9d484fcc4221c` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:41.777064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ee160fd23b47489bb9d484fcc4221c)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:41.778983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:41.823277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ee160fd23b47489bb9d484fcc4221c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:41.834435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ee160fd23b47489bb9d484fcc4221c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:41.841348 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ee160fd23b47489bb9d484fcc4221c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:41.842587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ee160fd23b47489bb9d484fcc4221c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:41.850938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ee160fd23b47489bb9d484fcc4221c'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:41.856720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1244/2491] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:41 2022] DELETE /identity/v3/users/47ee160fd23b47489bb9d484fcc4221c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:41.861195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:41.861675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:41.861788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:41.879241 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:41.880431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:41.936126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1248/2492] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:41.945657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:41.947062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:42.001447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9ccd-fdc4-4c5b-9eb7-6bd107fbeefb admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:42.005013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:42.005645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:42.005926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:42.006201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:42.014842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:42.016309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:42.026318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1245/2493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:42.282514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:42.283981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:42.296873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e02deb-a099-4c5f-b52a-cc86f1dff3dc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:42.306937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:42.307952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:42.308244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:42.308521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] PATH_INFO: `/v3/projects/e9126d8dbfac42fb9341e648aff9cb9f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:42.309855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9126d8dbfac42fb9341e648aff9cb9f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:42.311727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:42.364225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9126d8dbfac42fb9341e648aff9cb9f', 'request_id': 'req-84074f3f-c240-4b2e-a7c2-ddef564f6395'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.373030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9126d8dbfac42fb9341e648aff9cb9f', 'request_id': 'req-84074f3f-c240-4b2e-a7c2-ddef564f6395'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.379986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9126d8dbfac42fb9341e648aff9cb9f', 'request_id': 'req-84074f3f-c240-4b2e-a7c2-ddef564f6395'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.392182 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] The token cache is being invalidate because project e9126d8dbfac42fb9341e648aff9cb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:42.392470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.393131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.395686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1249/2494] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:42 2022] DELETE /identity/v3/projects/e9126d8dbfac42fb9341e648aff9cb9f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:42.399697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:42.409829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61135f-31a5-403b-ad9b-861aad9d2475 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:42.470062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:42.471027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:42.471495 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:42.471775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] PATH_INFO: `/v3/users/54d45f59c7fb4f2a81b942dba69a575d` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:42.473030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d45f59c7fb4f2a81b942dba69a575d)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:42.475024 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:42.526882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d45f59c7fb4f2a81b942dba69a575d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.538324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d45f59c7fb4f2a81b942dba69a575d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.544965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d45f59c7fb4f2a81b942dba69a575d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.545602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d45f59c7fb4f2a81b942dba69a575d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.552132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7035a580-e561-4c20-9cef-abc9688d4761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d45f59c7fb4f2a81b942dba69a575d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.557824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1246/2495] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:50:42 2022] DELETE /identity/v3/users/54d45f59c7fb4f2a81b942dba69a575d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:42.820163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:42.822032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:42.835560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84074f3f-c240-4b2e-a7c2-ddef564f6395 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:42.890421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:42.891342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:42.891629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:42.891905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] PATH_INFO: `/v3/projects/8b5f3a6f396f4651a132225a779cf783` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:42.893118 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5f3a6f396f4651a132225a779cf783)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:42.895335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:42.939003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5f3a6f396f4651a132225a779cf783', 'request_id': 'req-3bce61a1-91d8-4643-a85e-43a01bdc7db5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.946342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5f3a6f396f4651a132225a779cf783', 'request_id': 'req-3bce61a1-91d8-4643-a85e-43a01bdc7db5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.951612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5f3a6f396f4651a132225a779cf783', 'request_id': 'req-3bce61a1-91d8-4643-a85e-43a01bdc7db5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.962001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] The token cache is being invalidate because project 8b5f3a6f396f4651a132225a779cf783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:50:42.962289 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.962916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-3bce61a1-91d8-4643-a85e-43a01bdc7db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:50:42.964466 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1250/2496] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:50:42 2022] DELETE /identity/v3/projects/8b5f3a6f396f4651a132225a779cf783 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:50:42.969282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:42.969746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:42.969866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:42.986657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:42.987900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:43.046219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1247/2497] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:43.054443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.054742 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.055030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.057709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.059335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:43.074209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:43.075481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:43.087535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1251/2498] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:43.088577 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.098464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22c090-8339-466e-858d-158a2435e4d7 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.103792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.104792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.105153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.105499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.106300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:50:43.106798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.108637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.121448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1252/2499] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:50:43.125830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.136391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f706f-2541-4ca9-9ff1-f91f2971c4a2 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.137239 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139acf-c43e-491a-9a3a-9cd931ee064c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.141650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.142446 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.142739 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.142938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.143162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.143939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.144209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.144376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.144554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.146319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:43.146554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.158993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.161347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.173272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1248/2500] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:50:43.174313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1253/2501] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:50:43 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:50:43.178894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.196730 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691f8b-4dda-47d2-8bc1-8493d0f71202 service placement] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.250759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.251453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.251735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.252010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.252688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.254647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.276550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1249/2502] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:50:43 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:50:43.280814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.291591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8c04-dacc-4874-af0d-790379ec2a77 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.296188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212874b-4724-436e-826a-1443008729db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.296848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212874b-4724-436e-826a-1443008729db admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.297133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212874b-4724-436e-826a-1443008729db admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.297409 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212874b-4724-436e-826a-1443008729db admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.298133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212874b-4724-436e-826a-1443008729db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.299761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212874b-4724-436e-826a-1443008729db admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.309937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1254/2503] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:50:43.313924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.323622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f69c6-2e68-4082-811d-fb78d67f5e3a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.328346 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f52d9b-4929-49e4-b772-28181659c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.329004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f52d9b-4929-49e4-b772-28181659c088 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.329285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f52d9b-4929-49e4-b772-28181659c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.329558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f52d9b-4929-49e4-b772-28181659c088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.330307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f52d9b-4929-49e4-b772-28181659c088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.331940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f52d9b-4929-49e4-b772-28181659c088 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.341897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1250/2504] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:50:43.345792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212874b-4724-436e-826a-1443008729db admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.356040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212874b-4724-436e-826a-1443008729db admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.360841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.361782 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.362073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.362457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] PATH_INFO: `/v3/projects/6f64e1d6a9a44c429646712a762a2add/users/7d931327da8c4e4e954d04df31b863c9/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.377314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f64e1d6a9a44c429646712a762a2add, user_id=7d931327da8c4e4e954d04df31b863c9, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.380077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.394258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1255/2505] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:50:43 2022] PUT /identity/v3/projects/6f64e1d6a9a44c429646712a762a2add/users/7d931327da8c4e4e954d04df31b863c9/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:50:43.456788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e757e-676a-4591-80c4-09b0eb633a53 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.457520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e757e-676a-4591-80c4-09b0eb633a53 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.457831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e757e-676a-4591-80c4-09b0eb633a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.483624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-660e757e-676a-4591-80c4-09b0eb633a53 None None] MFA Rules not processed for user `7d931327da8c4e4e954d04df31b863c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:43.484821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-660e757e-676a-4591-80c4-09b0eb633a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:43.548250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1251/2506] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:50:43.560587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:50:43.562328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:43.620630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed1f14-bf8b-4721-a670-8703716a9943 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:50:43.624379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:50:43.625021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:43.625304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:43.625580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:43.633758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:50:43.635208 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:50:43.644232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1256/2507] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:50:54.383709 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:50:54.384233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:50:54.384339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:50:54.401611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] MFA Rules not processed for user `7f0abeff2be84d51854bd3231864669e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:50:54.402815 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:50:54.455322 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1252/2508] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:10.078337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:10.079812 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:10.151956 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aadd5-4754-4da9-874f-f02ea27335b6 service glance] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:10.157597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:10.158248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:10.158524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:10.158804 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:10.160635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:10.172841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:10.174412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92293971-6c64-4132-919a-a635f6d57044 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:10.184932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1257/2509] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:51:17.046486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:17.048236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:17.102004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814340a6-0532-4d68-9ca6-5436b283697c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:17.105609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:17.106570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:17.106570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:17.106785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:17.108628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:17.166680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:17.168143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:17.177515 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1253/2510] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:51:17.862278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:17.862891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:17.862998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:17.895742 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:17.896961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:17.960080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1258/2511] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:18.008382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:18.009859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:18.079066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906dec0-f526-4d4d-8ae0-b99032a65101 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:18.084215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7bab9-9eaa-49fa-a6f1-c77084d142cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:18.085288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7bab9-9eaa-49fa-a6f1-c77084d142cb service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:18.085615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7bab9-9eaa-49fa-a6f1-c77084d142cb service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:18.085894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7bab9-9eaa-49fa-a6f1-c77084d142cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:18.094232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7bab9-9eaa-49fa-a6f1-c77084d142cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:18.095849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7bab9-9eaa-49fa-a6f1-c77084d142cb service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:18.103725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1254/2512] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 29 18:51:18.970544 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:19.061054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bac90-14bc-4aeb-b3ed-71fcab6e53c9 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:19.066548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:19.075486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:19.077697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:19.078452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] PATH_INFO: `/v3/users/7d931327da8c4e4e954d04df31b863c9` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:19.080654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d931327da8c4e4e954d04df31b863c9)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:19.088759 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:19.174425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d931327da8c4e4e954d04df31b863c9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:19.192801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d931327da8c4e4e954d04df31b863c9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:19.205264 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d931327da8c4e4e954d04df31b863c9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:19.205789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d931327da8c4e4e954d04df31b863c9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:19.206445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d931327da8c4e4e954d04df31b863c9'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:19.223585 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1259/2513] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:51:18 2022] DELETE /identity/v3/users/7d931327da8c4e4e954d04df31b863c9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:51:19.227883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:19.228355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:19.228469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:19.248237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:19.250308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:19.350213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1255/2514] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:19.363770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:19.365284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:19.427211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab56ee-cb77-4518-9dda-1b428ab91099 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:19.432464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77380-13f3-470f-8de7-cc57e8696a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:19.433353 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77380-13f3-470f-8de7-cc57e8696a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:19.433645 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77380-13f3-470f-8de7-cc57e8696a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:19.433927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77380-13f3-470f-8de7-cc57e8696a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:19.452629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77380-13f3-470f-8de7-cc57e8696a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:19.454174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77380-13f3-470f-8de7-cc57e8696a37 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:19.471663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1260/2515] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:51:19.916166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:19.918431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:19.941045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29859d0f-cce3-4943-8355-ba301b13cdb2 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:19.950108 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab40899-559d-497e-836d-05975b965805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:19.950998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab40899-559d-497e-836d-05975b965805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:19.951491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab40899-559d-497e-836d-05975b965805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:19.952473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab40899-559d-497e-836d-05975b965805 admin admin] PATH_INFO: `/v3/projects/6f64e1d6a9a44c429646712a762a2add` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:19.955433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab40899-559d-497e-836d-05975b965805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f64e1d6a9a44c429646712a762a2add)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:19.960935 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab40899-559d-497e-836d-05975b965805 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.061086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-dab40899-559d-497e-836d-05975b965805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f64e1d6a9a44c429646712a762a2add', 'request_id': 'req-dab40899-559d-497e-836d-05975b965805'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:20.072186 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-dab40899-559d-497e-836d-05975b965805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f64e1d6a9a44c429646712a762a2add', 'request_id': 'req-dab40899-559d-497e-836d-05975b965805'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:20.079396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-dab40899-559d-497e-836d-05975b965805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f64e1d6a9a44c429646712a762a2add', 'request_id': 'req-dab40899-559d-497e-836d-05975b965805'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:20.093779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-dab40899-559d-497e-836d-05975b965805 admin admin] The token cache is being invalidate because project 6f64e1d6a9a44c429646712a762a2add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:51:20.094130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-dab40899-559d-497e-836d-05975b965805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:20.094723 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-dab40899-559d-497e-836d-05975b965805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:20.100861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1256/2516] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:51:19 2022] DELETE /identity/v3/projects/6f64e1d6a9a44c429646712a762a2add => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:51:20.102563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.103040 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.103295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.122276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:20.123557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:20.201934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1261/2517] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:51:20.210735 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.211064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.211460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.235664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:20.237918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:20.250454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1257/2518] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:51:20.251752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.262537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab65d-d724-4d93-988c-f9c40df81c73 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.271807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.272484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.272793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.273086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.273823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:51:20.274129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.275797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.292025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1262/2519] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:51:20.293247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.303965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c640b9e-0904-4d7d-8971-532ae6c795a7 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.310950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.311952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.312306 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.312649 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.313412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.315672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.350688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1258/2520] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:51:20 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:51:20.355426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.365903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca85f3-9307-4af6-a66e-6fbe24cf5fd9 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.447807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.449763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.450031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.450522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.452190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.456151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.498092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.499709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1263/2521] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:51:20 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:51:20.510865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e0097-403d-4528-aaff-3db45bd6e1cd admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.515504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.516171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.516586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.517017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.519782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.519945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.533538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1259/2522] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:51:20.537596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.547895 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902134-eedf-4788-bd72-c905f7bb1904 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.553281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0969b3b-0434-4728-a852-118b745a5aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.554119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0969b3b-0434-4728-a852-118b745a5aac admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.554512 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0969b3b-0434-4728-a852-118b745a5aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.554897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0969b3b-0434-4728-a852-118b745a5aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.555808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0969b3b-0434-4728-a852-118b745a5aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.557509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0969b3b-0434-4728-a852-118b745a5aac admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.571214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1264/2523] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:51:20.575420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.592089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9786-6827-4ba9-9741-b40cdfb9d53b admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.598093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.599027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.599439 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.599830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] PATH_INFO: `/v3/projects/859382da1e70430ea905cb320e11c27c/users/0fbecbaf1c2c4caf8ccd3a3f5dd3c9be/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.621821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859382da1e70430ea905cb320e11c27c, user_id=0fbecbaf1c2c4caf8ccd3a3f5dd3c9be, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.624727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.648906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1260/2524] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:51:20 2022] PUT /identity/v3/projects/859382da1e70430ea905cb320e11c27c/users/0fbecbaf1c2c4caf8ccd3a3f5dd3c9be/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:51:20.650740 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfdcf-5278-4866-961a-c8fbec6b8ec3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.651165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfdcf-5278-4866-961a-c8fbec6b8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.651560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfdcf-5278-4866-961a-c8fbec6b8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.669422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9dadfdcf-5278-4866-961a-c8fbec6b8ec3 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:20.670822 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9dadfdcf-5278-4866-961a-c8fbec6b8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:20.747794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1265/2525] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:20.760094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:20.761938 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:20.839416 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616db72-7cf1-442e-8962-84303eb5ede4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:20.843268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:20.844170 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:20.844453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:20.844758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:20.857244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:20.858737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:20.871417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1261/2526] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:51:21.859102 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e4dc-2142-4166-bc26-0a70a524dc48 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:21.860133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e4dc-2142-4166-bc26-0a70a524dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:21.860573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e4dc-2142-4166-bc26-0a70a524dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:21.902057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-acc9e4dc-2142-4166-bc26-0a70a524dc48 None None] MFA Rules not processed for user `0fbecbaf1c2c4caf8ccd3a3f5dd3c9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:21.903374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-acc9e4dc-2142-4166-bc26-0a70a524dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:21.998766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1266/2527] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:22.016647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:22.018085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:22.124370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53712adc-a5e7-458c-b6bc-1181a211dea3 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:22.128284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:22.129347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:22.129638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:22.130118 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:22.140928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:22.142388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:22.153044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1262/2528] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:51:23.650636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:23.651180 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:23.651412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:23.682082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] MFA Rules not processed for user `0fbecbaf1c2c4caf8ccd3a3f5dd3c9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:23.685362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:23.707299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1267/2529] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:51:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:23.955224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:23.968270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae285c33-6c1b-4e26-a7b8-b55d90c9da16 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:23.975200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:23.976419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:23.976726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:23.977206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:23.979429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:24.011237 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:24.013155 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:24.027652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1263/2530] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:51:33.114787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:33.118941 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:33.142573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a9ea3-040d-4828-8fb1-30193564ebaf None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:33.148113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:33.149131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:33.149511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:33.149886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] PATH_INFO: `/v3/users/b2fa81478fee4b6182d0595d6dcf0e86` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:33.151249 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fa81478fee4b6182d0595d6dcf0e86)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:33.153317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:33.206252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fa81478fee4b6182d0595d6dcf0e86'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.222561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fa81478fee4b6182d0595d6dcf0e86'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.231492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fa81478fee4b6182d0595d6dcf0e86'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.232234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fa81478fee4b6182d0595d6dcf0e86'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.232946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fa81478fee4b6182d0595d6dcf0e86'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.247205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1268/2531] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:51:33 2022] DELETE /identity/v3/users/b2fa81478fee4b6182d0595d6dcf0e86 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:51:33.427818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:33.440610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11fb1-22f0-4961-a4c8-c615c7e6d006 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:33.501490 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:33.502347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:33.502635 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:33.502911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] PATH_INFO: `/v3/projects/4d33d76135cb4dddbcaf0e7228e3b3b5` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:33.504105 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d33d76135cb4dddbcaf0e7228e3b3b5)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:33.506020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:33.550110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d33d76135cb4dddbcaf0e7228e3b3b5', 'request_id': 'req-104e1ea4-5e4e-40d3-906d-14336a178ef2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.557529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d33d76135cb4dddbcaf0e7228e3b3b5', 'request_id': 'req-104e1ea4-5e4e-40d3-906d-14336a178ef2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.562785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d33d76135cb4dddbcaf0e7228e3b3b5', 'request_id': 'req-104e1ea4-5e4e-40d3-906d-14336a178ef2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.573398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] The token cache is being invalidate because project 4d33d76135cb4dddbcaf0e7228e3b3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:51:33.573690 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.574324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.575868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1264/2532] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:51:33 2022] DELETE /identity/v3/projects/4d33d76135cb4dddbcaf0e7228e3b3b5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:51:33.579769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:33.581161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:33.594790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6ffdf-5dad-4b97-9eea-f688cb9ec104 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:33.651317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:33.652198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:33.652484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:33.652763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] PATH_INFO: `/v3/users/60b590ae8c3a405b9d6d1b92b578a7a2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:33.653954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b590ae8c3a405b9d6d1b92b578a7a2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:33.656014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:33.701134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b590ae8c3a405b9d6d1b92b578a7a2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.712764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b590ae8c3a405b9d6d1b92b578a7a2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.719906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b590ae8c3a405b9d6d1b92b578a7a2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.720522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b590ae8c3a405b9d6d1b92b578a7a2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.721116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-05d008d7-272a-4829-931b-05844b3969db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b590ae8c3a405b9d6d1b92b578a7a2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:33.732876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1269/2533] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:51:33 2022] DELETE /identity/v3/users/60b590ae8c3a405b9d6d1b92b578a7a2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:51:33.900452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:33.902043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:33.915778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e1ea4-5e4e-40d3-906d-14336a178ef2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:33.971989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:33.972765 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:33.973044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:33.973318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] PATH_INFO: `/v3/projects/dd7095df1d9447b3876e6ceb28d5cfd1` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:33.974520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7095df1d9447b3876e6ceb28d5cfd1)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:33.977052 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:34.021193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7095df1d9447b3876e6ceb28d5cfd1', 'request_id': 'req-00bad89c-cc22-4d3b-911e-99ec39a54001'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:34.028370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7095df1d9447b3876e6ceb28d5cfd1', 'request_id': 'req-00bad89c-cc22-4d3b-911e-99ec39a54001'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:34.033741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7095df1d9447b3876e6ceb28d5cfd1', 'request_id': 'req-00bad89c-cc22-4d3b-911e-99ec39a54001'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:34.046450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] The token cache is being invalidate because project dd7095df1d9447b3876e6ceb28d5cfd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:51:34.046786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:34.047903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-00bad89c-cc22-4d3b-911e-99ec39a54001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:51:34.049459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1265/2534] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:51:33 2022] DELETE /identity/v3/projects/dd7095df1d9447b3876e6ceb28d5cfd1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:51:39.248765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc25ab-f86f-4d02-8b72-71ed19758670 None None] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:39.249267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc25ab-f86f-4d02-8b72-71ed19758670 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:39.249385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc25ab-f86f-4d02-8b72-71ed19758670 None None] PATH_INFO: `/` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:39.250817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1270/2535] 10.222.0.45 () {54 vars in 921 bytes} [Fri Apr 29 18:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 18:51:39.255704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09b269-7c8e-495f-8d70-b4d0a47585bc None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:39.256181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09b269-7c8e-495f-8d70-b4d0a47585bc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:39.256330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09b269-7c8e-495f-8d70-b4d0a47585bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:39.274356 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-7c09b269-7c8e-495f-8d70-b4d0a47585bc None None] MFA Rules not processed for user `9c539d6a3d1d49bcaadcea8970560c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:39.275705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7c09b269-7c8e-495f-8d70-b4d0a47585bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:39.347267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1266/2536] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Apr 29 18:51:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:51:39.358947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc25ab-f86f-4d02-8b72-71ed19758670 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:39.360872 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-10dc25ab-f86f-4d02-8b72-71ed19758670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:39.424184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc25ab-f86f-4d02-8b72-71ed19758670 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:39.427750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:39.428397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:39.428699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:39.428961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:39.442945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:39.444448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:39.455724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1271/2537] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:51:44.079372 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d089-1da7-49ea-997b-e18da80bbdfd None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:44.079928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d089-1da7-49ea-997b-e18da80bbdfd None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:44.079928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d089-1da7-49ea-997b-e18da80bbdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:44.097772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e1d2d089-1da7-49ea-997b-e18da80bbdfd None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:51:44.098988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e1d2d089-1da7-49ea-997b-e18da80bbdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:44.165165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1267/2538] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:51:44.177778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:51:44.179360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:51:44.249119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89178cdb-f581-41b1-9e11-35d2ef00509f service glance] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:51:44.254517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:51:44.255190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:51:44.255478 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:51:44.255756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:51:44.264711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:51:44.266286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:51:44.274325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1272/2539] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:52:10.581351 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64dcea-9935-4814-ad2c-af4a654bf8e1 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:10.581909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64dcea-9935-4814-ad2c-af4a654bf8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:10.581909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64dcea-9935-4814-ad2c-af4a654bf8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:10.600673 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4f64dcea-9935-4814-ad2c-af4a654bf8e1 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:10.601878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4f64dcea-9935-4814-ad2c-af4a654bf8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:10.658220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1268/2540] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:10.685382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:10.686839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:10.702262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b78d92-caea-4bea-8ebc-7c0b1ab18167 service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:10.707730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:10.708365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:10.708647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:10.708923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:10.717025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:10.718584 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:10.727732 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1273/2541] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:11.943638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f2f9-1713-43c9-9f0c-1d5533d8979d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:11.944111 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f2f9-1713-43c9-9f0c-1d5533d8979d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:11.944238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f2f9-1713-43c9-9f0c-1d5533d8979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:11.963557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-fcb8f2f9-1713-43c9-9f0c-1d5533d8979d None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:11.965179 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fcb8f2f9-1713-43c9-9f0c-1d5533d8979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:11.972863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1269/2542] 10.222.0.45 () {58 vars in 967 bytes} [Fri Apr 29 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:11.984866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:11.996794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6babe-8f31-429b-91fa-282ad125f8e2 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:12.002283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:12.002920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:12.003244 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:12.003518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:12.011315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:12.012863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:12.020915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1274/2543] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:52:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:52:16.605414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:16.605969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:16.606229 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:16.624122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:16.625594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:16.637693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1270/2544] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:16.657787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:16.659268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:16.674950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5fda-08c8-4e0f-b14b-567d5eb30907 service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:16.680506 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812b3a-cc8b-417f-a92c-2242deaeba71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:16.681248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812b3a-cc8b-417f-a92c-2242deaeba71 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:16.681605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812b3a-cc8b-417f-a92c-2242deaeba71 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:16.681953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812b3a-cc8b-417f-a92c-2242deaeba71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:16.692378 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812b3a-cc8b-417f-a92c-2242deaeba71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:16.694069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812b3a-cc8b-417f-a92c-2242deaeba71 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:16.707936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1275/2545] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:20.156381 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:20.158455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:20.211867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c631eaa-5d8b-4276-b0ca-e815bd6ec409 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:20.215469 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:20.216115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:20.216398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:20.216675 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:20.218441 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:20.230476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:20.231931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:20.241268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1271/2546] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:20.874311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:20.874849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:20.874960 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:20.895025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:20.896260 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:20.904592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1276/2547] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:20.924611 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:20.937256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ee8a-10b8-443e-993b-07c28d6b2376 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:20.943640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:20.944286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:20.944596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:20.944876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:20.953271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:20.954864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:20.964366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1272/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:23.411327 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:23.413069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:23.430522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90611c-5d29-43fc-ab4c-9ca2434cb636 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:23.435586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:23.436626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:23.437107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:23.437578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] PATH_INFO: `/v3/users/aeea9d59c41341db8496a2c63d8655fa` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:23.439554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeea9d59c41341db8496a2c63d8655fa)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:23.441484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:23.495708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeea9d59c41341db8496a2c63d8655fa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.508183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeea9d59c41341db8496a2c63d8655fa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.516370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeea9d59c41341db8496a2c63d8655fa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.517127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeea9d59c41341db8496a2c63d8655fa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.517846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4c35529b-92fe-4e46-b8e5-49dbeffa4ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeea9d59c41341db8496a2c63d8655fa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.530482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1277/2549] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:23 2022] DELETE /identity/v3/users/aeea9d59c41341db8496a2c63d8655fa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:23.702224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:23.713560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc28939-36e0-4697-9677-ee1f76b57e0a service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:23.776026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:23.776877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:23.777160 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:23.777438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] PATH_INFO: `/v3/projects/7b9988dc509f4800bba1d1b66fa271d2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:23.778605 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9988dc509f4800bba1d1b66fa271d2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:23.780540 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:23.824995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9988dc509f4800bba1d1b66fa271d2', 'request_id': 'req-1d51fd60-8802-44d4-8319-37d5b2f3a641'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.831503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9988dc509f4800bba1d1b66fa271d2', 'request_id': 'req-1d51fd60-8802-44d4-8319-37d5b2f3a641'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.836741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9988dc509f4800bba1d1b66fa271d2', 'request_id': 'req-1d51fd60-8802-44d4-8319-37d5b2f3a641'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.847932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] The token cache is being invalidate because project 7b9988dc509f4800bba1d1b66fa271d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:23.848223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.848851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-1d51fd60-8802-44d4-8319-37d5b2f3a641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:23.850440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1273/2550] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:23 2022] DELETE /identity/v3/projects/7b9988dc509f4800bba1d1b66fa271d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:23.855445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:23.855729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:23.856053 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:23.873678 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:23.874854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:23.930831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1278/2551] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:23.938595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:23.938882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:23.939181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:23.957227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:23.958333 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:23.966140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1274/2552] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:23.971121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:23.980645 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e389e3f-2ef1-4dd3-893e-a32e5c652c3c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:23.985177 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:23.985859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:23.986144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:23.986422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:23.987173 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:52:23.987485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:23.989083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.000413 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1279/2553] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:52:24.004399 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.013510 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e375b01-354c-4a91-9b17-6e5f268f7047 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.018678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.019364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.019918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.020198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.020882 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.022825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.048287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1275/2554] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:24.052337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.062023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827350-eab5-4729-86b8-7439726e7461 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.115790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.116452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.116733 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.117024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.117697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.119634 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.138786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1280/2555] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:24.143419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.153900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3131-2643-44f8-8b4d-30244b7d6322 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.159344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.160003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.160285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.160558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.161274 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.162883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.172964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1276/2556] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:52:24.177023 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.187860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62669f-f3a8-4922-a0c2-21af951565c0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.193054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8e523-0dff-4001-8f95-a4d54f2bf1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.193744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8e523-0dff-4001-8f95-a4d54f2bf1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.194041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8e523-0dff-4001-8f95-a4d54f2bf1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.194313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8e523-0dff-4001-8f95-a4d54f2bf1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.195073 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8e523-0dff-4001-8f95-a4d54f2bf1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.196776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8e523-0dff-4001-8f95-a4d54f2bf1bc admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.207652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1281/2557] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:52:24.211549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.222906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afa10e-8681-459d-b087-2f4f016539f4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.227541 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.228403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.228682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.228957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] PATH_INFO: `/v3/projects/e5e49964cd794c94a0dd14ace26c9e2b/users/744e6eaf60144dbda14055f8f3e1a694/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.242854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e49964cd794c94a0dd14ace26c9e2b, user_id=744e6eaf60144dbda14055f8f3e1a694, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.245523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.257329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1277/2558] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:24 2022] PUT /identity/v3/projects/e5e49964cd794c94a0dd14ace26c9e2b/users/744e6eaf60144dbda14055f8f3e1a694/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:24.268562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.268875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.269157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.295487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] MFA Rules not processed for user `744e6eaf60144dbda14055f8f3e1a694`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:24.296702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:24.360736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1282/2559] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:24.365231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.426657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0234ed-4f46-4ce9-8b30-3e1d1258e594 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.433000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.433681 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.433962 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.434236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.434924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.436892 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.464519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1278/2560] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:24.468630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.479133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45769f-c6fd-4d0f-8af0-49582b6f8bed None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.533377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.534048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.534345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.534625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.535351 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.537301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.559047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1283/2561] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:24.560614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.571447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d56d15-2896-475a-9cd1-61007181dfa9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.575937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.576581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.576864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.577147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.577855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.580089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.590034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1279/2562] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:24.594077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.603848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2380-a329-434d-b1ac-39dc7fe52fbb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.608435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.609306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.609593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.609876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] PATH_INFO: `/v3/projects/3d9000ae511648b0954d7f3cfe2cd025/users/4eaa4659b62d4f5ea5e629727b83f8f8/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.623842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9000ae511648b0954d7f3cfe2cd025, user_id=4eaa4659b62d4f5ea5e629727b83f8f8, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.627213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.639605 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1284/2563] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:24 2022] PUT /identity/v3/projects/3d9000ae511648b0954d7f3cfe2cd025/users/4eaa4659b62d4f5ea5e629727b83f8f8/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:24.644122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.654199 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6280022-52a4-4942-a2dd-9f8bda2ebb02 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.708981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0abfb-01ac-46f1-a76b-c93ee9761507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.709632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0abfb-01ac-46f1-a76b-c93ee9761507 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.709900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0abfb-01ac-46f1-a76b-c93ee9761507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.710171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0abfb-01ac-46f1-a76b-c93ee9761507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.710886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0abfb-01ac-46f1-a76b-c93ee9761507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.712511 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0abfb-01ac-46f1-a76b-c93ee9761507 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.721622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1280/2564] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:24.725638 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.736456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06816-de28-4330-9632-59c78fb24ece admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.741129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.742012 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.742304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.742725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] PATH_INFO: `/v3/projects/3d9000ae511648b0954d7f3cfe2cd025/users/4eaa4659b62d4f5ea5e629727b83f8f8/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.744734 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9000ae511648b0954d7f3cfe2cd025, user_id=4eaa4659b62d4f5ea5e629727b83f8f8, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.747593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.758218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1285/2565] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:24 2022] PUT /identity/v3/projects/3d9000ae511648b0954d7f3cfe2cd025/users/4eaa4659b62d4f5ea5e629727b83f8f8/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:24.768284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad910e-1efb-46eb-b3a5-bf1413acc89d None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.768571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad910e-1efb-46eb-b3a5-bf1413acc89d None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.768861 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad910e-1efb-46eb-b3a5-bf1413acc89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.793895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-afad910e-1efb-46eb-b3a5-bf1413acc89d None None] MFA Rules not processed for user `4eaa4659b62d4f5ea5e629727b83f8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:24.795071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-afad910e-1efb-46eb-b3a5-bf1413acc89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:24.864979 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1281/2566] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:24.873773 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:24.875593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:24.934025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c8f2-3c6c-4699-a2ed-a5f729aa1f0b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:24.937794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:24.938443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.938737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.939579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.942883 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:24.943218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:24.943529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:24.948581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:24.950008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:24.959694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1286/2567] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:24.961583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:24.962788 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:25.033625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1282/2568] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:25.040662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:25.050162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416212e-5647-40dc-8fa1-0650c336d322 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:25.053921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaab5f-d4d8-46f7-873a-f5498daaeb58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:25.054562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaab5f-d4d8-46f7-873a-f5498daaeb58 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:25.054845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaab5f-d4d8-46f7-873a-f5498daaeb58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:25.055140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaab5f-d4d8-46f7-873a-f5498daaeb58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:25.056332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:25.057738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:25.109979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaab5f-d4d8-46f7-873a-f5498daaeb58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:25.112108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaab5f-d4d8-46f7-873a-f5498daaeb58 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:25.120936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1287/2569] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:25.129252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95198e72-189b-44ad-b3ad-01e6e2a00063 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:25.134917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:25.135656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:25.136002 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:25.136338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:25.145354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:25.147162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:25.156727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1283/2570] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:52:29.124965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:29.125426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:29.125713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:29.144954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:29.146176 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:29.158581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1288/2571] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:29.182185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:29.183694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:29.199545 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2e59e-f8f0-4451-93f0-ddcf0e8632f3 service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:29.205580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0367c8-049a-4d75-879b-cae7e6f85b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:29.206298 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0367c8-049a-4d75-879b-cae7e6f85b92 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:29.206586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0367c8-049a-4d75-879b-cae7e6f85b92 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:29.206864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0367c8-049a-4d75-879b-cae7e6f85b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:29.216844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0367c8-049a-4d75-879b-cae7e6f85b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:29.218781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0367c8-049a-4d75-879b-cae7e6f85b92 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:29.228865 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1284/2572] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:31.794426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:31.803758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4054-6343-44ea-922b-51429f9cb55a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:31.808187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:31.809047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:31.809328 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:31.809600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] PATH_INFO: `/v3/users/744e6eaf60144dbda14055f8f3e1a694` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:31.810772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=744e6eaf60144dbda14055f8f3e1a694)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:31.812723 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:31.857225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744e6eaf60144dbda14055f8f3e1a694'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:31.868670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744e6eaf60144dbda14055f8f3e1a694'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:31.875802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744e6eaf60144dbda14055f8f3e1a694'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:31.876454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744e6eaf60144dbda14055f8f3e1a694'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:31.877593 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744e6eaf60144dbda14055f8f3e1a694'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:31.889693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1289/2573] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:31 2022] DELETE /identity/v3/users/744e6eaf60144dbda14055f8f3e1a694 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:31.894966 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:31.895518 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:31.895629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:31.912382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:31.913554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:31.969035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1285/2574] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:31.978505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:31.979921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:32.035705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68f17d-f1be-430b-a24a-b7d9be2cc21f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:32.039304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:32.039947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:32.040274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:32.040503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:32.049816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:32.051609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:32.060397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1290/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:32.336854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:32.338339 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:32.350434 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a670-0d1b-44aa-ab2e-c81b235c571c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:32.355245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:32.356102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:32.356385 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:32.356693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] PATH_INFO: `/v3/projects/e5e49964cd794c94a0dd14ace26c9e2b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:32.357993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e49964cd794c94a0dd14ace26c9e2b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:32.359939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:32.407176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e49964cd794c94a0dd14ace26c9e2b', 'request_id': 'req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.414523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e49964cd794c94a0dd14ace26c9e2b', 'request_id': 'req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.419839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e49964cd794c94a0dd14ace26c9e2b', 'request_id': 'req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.431526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] The token cache is being invalidate because project e5e49964cd794c94a0dd14ace26c9e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:32.431810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.432534 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.434151 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1286/2576] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:32 2022] DELETE /identity/v3/projects/e5e49964cd794c94a0dd14ace26c9e2b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:32.438197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:32.451833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1c0f5-7281-4b3c-b35f-0a78219256ec service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:32.513092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:32.513892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:32.514195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:32.514455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] PATH_INFO: `/v3/users/4eaa4659b62d4f5ea5e629727b83f8f8` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:32.515681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaa4659b62d4f5ea5e629727b83f8f8)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:32.517655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:32.561487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaa4659b62d4f5ea5e629727b83f8f8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.573556 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaa4659b62d4f5ea5e629727b83f8f8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.581090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaa4659b62d4f5ea5e629727b83f8f8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.581707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaa4659b62d4f5ea5e629727b83f8f8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.582306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-786126c1-64be-4121-93ba-b88ba71fc0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaa4659b62d4f5ea5e629727b83f8f8'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.594006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1291/2577] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:32 2022] DELETE /identity/v3/users/4eaa4659b62d4f5ea5e629727b83f8f8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:32.852041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:32.853488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:32.867359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16aec75-49b6-4c42-9a6e-5c98a3ea60ac admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:32.923488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:32.924879 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:32.925162 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:32.925438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] PATH_INFO: `/v3/projects/3d9000ae511648b0954d7f3cfe2cd025` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:32.926706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9000ae511648b0954d7f3cfe2cd025)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:32.928552 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:32.971918 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9000ae511648b0954d7f3cfe2cd025', 'request_id': 'req-e296e19f-01b4-4df8-b2d2-c6e138e5804b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.978749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9000ae511648b0954d7f3cfe2cd025', 'request_id': 'req-e296e19f-01b4-4df8-b2d2-c6e138e5804b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.983897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9000ae511648b0954d7f3cfe2cd025', 'request_id': 'req-e296e19f-01b4-4df8-b2d2-c6e138e5804b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.994684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] The token cache is being invalidate because project 3d9000ae511648b0954d7f3cfe2cd025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:32.994965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.995609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e296e19f-01b4-4df8-b2d2-c6e138e5804b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:32.997107 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1287/2578] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:32 2022] DELETE /identity/v3/projects/3d9000ae511648b0954d7f3cfe2cd025 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:33.003652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.004137 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.004234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.021797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:33.023061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:33.081128 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1292/2579] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:33.088858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.089154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.089437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.106965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:33.108377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:33.117276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1288/2580] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:33.121456 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.131430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7297-fd5a-4939-95d4-3d0c391d9b95 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.135901 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.136550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.136833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.137110 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.137832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:52:33.138135 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.139756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.151215 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1293/2581] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:52:33.155265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.164417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a80ff-3456-4147-903f-765a2ac2373e None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.169050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.169688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.169970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.170245 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.170967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.172902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.197648 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1289/2582] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:33.201416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.211068 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3ffb1-6862-4b6e-a8a3-04676e218d32 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.275058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.275764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.276050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.276332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.277030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.278953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.298093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1294/2583] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:33.302748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.312560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec12632-5b53-47db-a7d7-5aa21fd49848 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.317001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.317647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.317927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.318202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.318915 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.320556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.331881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1290/2584] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:33.335518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.345391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b7d07-b2a0-434c-b1bf-2df0aed0229b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.350767 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4ab9f-8774-4713-bf64-7c7b4fe986d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.351462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4ab9f-8774-4713-bf64-7c7b4fe986d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.351781 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4ab9f-8774-4713-bf64-7c7b4fe986d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.352091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4ab9f-8774-4713-bf64-7c7b4fe986d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.352821 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4ab9f-8774-4713-bf64-7c7b4fe986d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.354441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4ab9f-8774-4713-bf64-7c7b4fe986d6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.368542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1295/2585] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:33.369713 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.379747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4f73-6675-4719-8818-656c6c3671b7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.384329 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832df7-4a92-441f-8c8a-5bc745afda75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.385200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832df7-4a92-441f-8c8a-5bc745afda75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.385484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832df7-4a92-441f-8c8a-5bc745afda75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.385758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832df7-4a92-441f-8c8a-5bc745afda75 admin admin] PATH_INFO: `/v3/projects/4fc791b5b36648f2955ff96a37e305e7/users/f748a4ec28734c8e9207c667ba324705/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.400256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832df7-4a92-441f-8c8a-5bc745afda75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc791b5b36648f2955ff96a37e305e7, user_id=f748a4ec28734c8e9207c667ba324705, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.402928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832df7-4a92-441f-8c8a-5bc745afda75 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.416078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1291/2586] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:33 2022] PUT /identity/v3/projects/4fc791b5b36648f2955ff96a37e305e7/users/f748a4ec28734c8e9207c667ba324705/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:33.427844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.428139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.428424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.454522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] MFA Rules not processed for user `f748a4ec28734c8e9207c667ba324705`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:33.455776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:33.484855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.485173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.485478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.502946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:33.504171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:33.520124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1296/2587] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:33.524575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.562577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1292/2588] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:33.584996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.586284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:33.591493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c22603-dd64-4415-9b0b-3375a0919894 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.597709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.598390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.598675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.598951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.599672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.601566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.630527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1297/2589] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:33.631550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.672200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5e5ce-2caf-44b8-b2bc-1e90ff7adfa0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.690916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7399-f367-424f-8cb1-768aead4069d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.695650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.696377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.696692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.696971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.697658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.699704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.720093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1298/2590] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:33.724681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.733799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7ecb-6629-4439-8958-8ac7aa3ccc00 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.736705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.737359 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.737643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.737925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.738471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.739139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.739434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.739780 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.740429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.741998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.746230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.747968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.751535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1299/2591] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:52:33.755559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.757609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1293/2592] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:52:33.764769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c47fbb-ae9a-4560-8f82-5b9db4d3f54d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.770333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.771276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.771561 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.771868 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] PATH_INFO: `/v3/projects/5c1e5e06036d43f997cb369ee61003ca/users/dc301a10738d42e49df5396c887bb507/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.788252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1e5e06036d43f997cb369ee61003ca, user_id=dc301a10738d42e49df5396c887bb507, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.790949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.805427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1300/2593] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:33 2022] PUT /identity/v3/projects/5c1e5e06036d43f997cb369ee61003ca/users/dc301a10738d42e49df5396c887bb507/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:52:33.809741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.819897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aebbb-50af-4d10-a94c-a9761e34aa90 service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.879420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de041294-6eee-4fe1-9610-8c9b43e94976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.880104 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de041294-6eee-4fe1-9610-8c9b43e94976 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.880387 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de041294-6eee-4fe1-9610-8c9b43e94976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.880660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de041294-6eee-4fe1-9610-8c9b43e94976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.881392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de041294-6eee-4fe1-9610-8c9b43e94976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.884035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de041294-6eee-4fe1-9610-8c9b43e94976 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.898945 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1294/2594] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:33.900234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:33.911910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d573-66c4-4962-85ae-16563cb6fae7 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:33.917196 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:33.918113 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.918396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.918677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] PATH_INFO: `/v3/projects/5c1e5e06036d43f997cb369ee61003ca/users/dc301a10738d42e49df5396c887bb507/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.920714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1e5e06036d43f997cb369ee61003ca, user_id=dc301a10738d42e49df5396c887bb507, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:33.923392 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:33.934277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1301/2595] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:33 2022] PUT /identity/v3/projects/5c1e5e06036d43f997cb369ee61003ca/users/dc301a10738d42e49df5396c887bb507/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:33.944647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:33.945153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:33.945260 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:33.972462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] MFA Rules not processed for user `dc301a10738d42e49df5396c887bb507`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:33.973654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:34.040817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1295/2596] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:34.052006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:34.053753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:34.109092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80ae40-baec-4ca3-93d0-ee99071a0d2a admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:34.112783 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:34.113424 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:34.113715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:34.113995 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:34.122706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:34.124174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:34.133896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1302/2597] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:34.177927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:34.179343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:34.191498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8afe1-2c29-4843-bd0c-7759d54a5298 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:34.195023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdcbb2-89ac-4d78-8562-f11bfd3aa78b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:34.195697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdcbb2-89ac-4d78-8562-f11bfd3aa78b service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:34.195981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdcbb2-89ac-4d78-8562-f11bfd3aa78b service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:34.196259 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdcbb2-89ac-4d78-8562-f11bfd3aa78b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:34.249087 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdcbb2-89ac-4d78-8562-f11bfd3aa78b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:34.250553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdcbb2-89ac-4d78-8562-f11bfd3aa78b service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:34.259593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1296/2598] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:37.448082 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:37.508534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7f22-1e22-4ed5-901f-3d9f8ccc007c service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:37.512988 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:37.513854 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:37.514139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:37.514423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] PATH_INFO: `/v3/users/f748a4ec28734c8e9207c667ba324705` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:37.515624 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f748a4ec28734c8e9207c667ba324705)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:37.517588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:37.562841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f748a4ec28734c8e9207c667ba324705'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:37.575323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f748a4ec28734c8e9207c667ba324705'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:37.582902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f748a4ec28734c8e9207c667ba324705'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:37.583552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f748a4ec28734c8e9207c667ba324705'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:37.584158 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f748a4ec28734c8e9207c667ba324705'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:37.596114 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1303/2599] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:37 2022] DELETE /identity/v3/users/f748a4ec28734c8e9207c667ba324705 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:37.600849 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:37.601330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:37.601425 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:37.618171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:37.619415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:37.676795 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1297/2600] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:37.686032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:37.687531 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:37.748688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138b626-3759-4ec7-b353-4a97520505f6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:37.753070 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:37.753802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:37.754158 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:37.754518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:37.764509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:37.765939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:37.776277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1304/2601] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:52:38.030772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:38.032232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:38.044718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd771d3-bc73-46ab-b514-79e7d6288181 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:38.049994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:38.050864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.051189 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.051471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] PATH_INFO: `/v3/projects/4fc791b5b36648f2955ff96a37e305e7` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.052710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc791b5b36648f2955ff96a37e305e7)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:38.054573 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:38.099521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc791b5b36648f2955ff96a37e305e7', 'request_id': 'req-3f6dd092-f483-48bc-a2a4-54abbf7dee63'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.106481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc791b5b36648f2955ff96a37e305e7', 'request_id': 'req-3f6dd092-f483-48bc-a2a4-54abbf7dee63'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.112440 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc791b5b36648f2955ff96a37e305e7', 'request_id': 'req-3f6dd092-f483-48bc-a2a4-54abbf7dee63'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.122808 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] The token cache is being invalidate because project 4fc791b5b36648f2955ff96a37e305e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:38.123090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.123728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.125461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1298/2602] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:38 2022] DELETE /identity/v3/projects/4fc791b5b36648f2955ff96a37e305e7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:38.129151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:38.138345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033ac55-ec21-4692-a651-f73aa301d7f7 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:38.191093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:38.191981 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.192257 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.192529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] PATH_INFO: `/v3/users/dc301a10738d42e49df5396c887bb507` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.193695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc301a10738d42e49df5396c887bb507)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:38.195622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:38.237662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc301a10738d42e49df5396c887bb507'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.249660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc301a10738d42e49df5396c887bb507'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.256911 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc301a10738d42e49df5396c887bb507'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.257630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc301a10738d42e49df5396c887bb507'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.258226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-57fe73f2-9cca-466c-83ff-1e81dc9c7103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc301a10738d42e49df5396c887bb507'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.270792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1305/2603] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:38 2022] DELETE /identity/v3/users/dc301a10738d42e49df5396c887bb507 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:38.543267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:38.544989 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:38.558706 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd092-f483-48bc-a2a4-54abbf7dee63 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:38.617280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:38.618216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.618499 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.618771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] PATH_INFO: `/v3/projects/5c1e5e06036d43f997cb369ee61003ca` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.619970 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1e5e06036d43f997cb369ee61003ca)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:38.621866 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:38.667158 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1e5e06036d43f997cb369ee61003ca', 'request_id': 'req-7160ed13-6166-43af-a88d-b512b1680b69'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.674325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1e5e06036d43f997cb369ee61003ca', 'request_id': 'req-7160ed13-6166-43af-a88d-b512b1680b69'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.679740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1e5e06036d43f997cb369ee61003ca', 'request_id': 'req-7160ed13-6166-43af-a88d-b512b1680b69'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.690574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] The token cache is being invalidate because project 5c1e5e06036d43f997cb369ee61003ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:38.690854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.691488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7160ed13-6166-43af-a88d-b512b1680b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:38.692981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1299/2604] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:38 2022] DELETE /identity/v3/projects/5c1e5e06036d43f997cb369ee61003ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:38.697963 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.698419 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.698632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.715969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:38.717162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:38.774046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1306/2605] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:38.782086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.782429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.782665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.801045 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:38.802253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:38.819810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1300/2606] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:38.819918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:38.824948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485dfb-eb3f-4dbf-8a22-a44a247d5343 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:38.829765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:38.831002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.831321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.831603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.832336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:52:38.832642 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:38.834232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:38.849100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1307/2607] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:52:38.850203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:38.859220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d06f-d14e-4b10-9772-ae7cb97a6d50 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:38.864451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:38.865097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.865379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.865655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.866332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:38.868253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:38.893818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1301/2608] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:38 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:38.898842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:38.909431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c349-5565-44fd-a588-b4c2bdfca064 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:38.970184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:38.970863 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:38.971209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:38.971493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:38.972189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:38.974141 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:38.994873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1308/2609] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:38 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:38.998814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.009537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652e91-5c13-44cc-a0af-f3de8dcbc21e admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.014025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.014680 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.014963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.015276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.015998 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.017586 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.028230 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1302/2610] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:39.032066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.042459 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254999e-9cdf-4a76-8286-b8b131bda415 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.048842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beadc76-d84b-4bfc-9d94-d81dac19c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.050028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beadc76-d84b-4bfc-9d94-d81dac19c98f admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.050318 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beadc76-d84b-4bfc-9d94-d81dac19c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.050582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beadc76-d84b-4bfc-9d94-d81dac19c98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.051580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beadc76-d84b-4bfc-9d94-d81dac19c98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.052921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beadc76-d84b-4bfc-9d94-d81dac19c98f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.064430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1309/2611] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:39.067684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.078071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0899-44cd-4d24-ad97-3e3be7974771 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.082876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.083816 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.084069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.084361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] PATH_INFO: `/v3/projects/ace75fb8eeaf425d8abff84344e38d00/users/2b8b9431ec114e879f6a29252ed7a2b0/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.102843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace75fb8eeaf425d8abff84344e38d00, user_id=2b8b9431ec114e879f6a29252ed7a2b0, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.105624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.119050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1303/2612] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:39 2022] PUT /identity/v3/projects/ace75fb8eeaf425d8abff84344e38d00/users/2b8b9431ec114e879f6a29252ed7a2b0/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:39.130776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.131075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.131390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.157415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] MFA Rules not processed for user `2b8b9431ec114e879f6a29252ed7a2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:39.158625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:39.219903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1310/2613] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:39.224413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.282085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db30b1-795d-462e-bfb2-604f99709b30 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.287097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.287819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.288098 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.288369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.289048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.290936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.314727 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1304/2614] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:39 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:39.318743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.329020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478573-0bc5-492f-abfc-53f20ea0dbdc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.381948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.382613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.382894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.383197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.383891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.385841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.404505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1311/2615] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:39 2022] POST /identity/v3/users => generated 300 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:39.409066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.419349 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e15b2-33e8-4af4-94b2-b194b07118a0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.423916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.425143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.425427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.425704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.426418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.428050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.438100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1305/2616] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:39.442136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.451930 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c332e4-b8c9-4ed9-a8ff-7949fdb1e589 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.456421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.457299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.457581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.457857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] PATH_INFO: `/v3/projects/397df6e3477641858a6882822298b815/users/825abdd983324ce182241e46031073d4/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.475976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397df6e3477641858a6882822298b815, user_id=825abdd983324ce182241e46031073d4, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.478684 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.491579 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1312/2617] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:39 2022] PUT /identity/v3/projects/397df6e3477641858a6882822298b815/users/825abdd983324ce182241e46031073d4/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:39.495433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.505404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b4938-fd96-47fa-8f23-4ddbec7df776 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.558698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c29c8-5c63-41b6-9636-42fb7aeee2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.559379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c29c8-5c63-41b6-9636-42fb7aeee2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.559658 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c29c8-5c63-41b6-9636-42fb7aeee2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.559933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c29c8-5c63-41b6-9636-42fb7aeee2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.560646 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c29c8-5c63-41b6-9636-42fb7aeee2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.562226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c29c8-5c63-41b6-9636-42fb7aeee2a6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.571574 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1306/2618] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:52:39.575517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.585568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166346f-0c2b-43e4-bcbf-a926b4ec3451 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.590303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.591219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.591519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.591776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] PATH_INFO: `/v3/projects/397df6e3477641858a6882822298b815/users/825abdd983324ce182241e46031073d4/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.593728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397df6e3477641858a6882822298b815, user_id=825abdd983324ce182241e46031073d4, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.596900 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.606952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1313/2619] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:39 2022] PUT /identity/v3/projects/397df6e3477641858a6882822298b815/users/825abdd983324ce182241e46031073d4/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:52:39.617500 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.618006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.618201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.643280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] MFA Rules not processed for user `825abdd983324ce182241e46031073d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:39.644484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:39.709472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1307/2620] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:39.720056 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.722395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:39.780162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70424-fcd2-445f-8d6a-0adaff0cba47 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.784366 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdc6bd-f892-4f8d-b99c-cdd84581bcf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.785008 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc6bd-f892-4f8d-b99c-cdd84581bcf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.785295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc6bd-f892-4f8d-b99c-cdd84581bcf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.785574 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc6bd-f892-4f8d-b99c-cdd84581bcf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.794250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc6bd-f892-4f8d-b99c-cdd84581bcf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.796001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc6bd-f892-4f8d-b99c-cdd84581bcf5 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:39.805346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1314/2621] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:39.928828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:39.987114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b48138-d5da-40de-a2c0-7ae0a5f07845 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:39.991543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:39.992402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:39.992685 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:39.992959 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] PATH_INFO: `/v3/users/2b8b9431ec114e879f6a29252ed7a2b0` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:39.994275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8b9431ec114e879f6a29252ed7a2b0)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:39.996261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:40.040778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8b9431ec114e879f6a29252ed7a2b0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.052366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8b9431ec114e879f6a29252ed7a2b0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.059376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8b9431ec114e879f6a29252ed7a2b0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.059986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8b9431ec114e879f6a29252ed7a2b0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.067178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8b9431ec114e879f6a29252ed7a2b0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.072964 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1308/2622] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:39 2022] DELETE /identity/v3/users/2b8b9431ec114e879f6a29252ed7a2b0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:40.077636 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:40.077932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:40.078270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:40.098007 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:40.099632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:40.157115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1315/2623] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:40.166671 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:40.168172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:40.224922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554619-257a-4707-8803-ada56c473895 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:40.228595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:40.229243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:40.229528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:40.229807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:40.238819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:40.240289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:40.249836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1309/2624] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:40.504889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:40.506301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:40.518233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ec57-17ee-49b8-8eb0-33a74373c183 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:40.523529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:40.524431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:40.524715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:40.524992 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] PATH_INFO: `/v3/projects/ace75fb8eeaf425d8abff84344e38d00` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:40.526189 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace75fb8eeaf425d8abff84344e38d00)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:40.528238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:40.573282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace75fb8eeaf425d8abff84344e38d00', 'request_id': 'req-f84924f3-4108-4229-86c7-07306f3bbff2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.580481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace75fb8eeaf425d8abff84344e38d00', 'request_id': 'req-f84924f3-4108-4229-86c7-07306f3bbff2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.585665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace75fb8eeaf425d8abff84344e38d00', 'request_id': 'req-f84924f3-4108-4229-86c7-07306f3bbff2'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.596211 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] The token cache is being invalidate because project ace75fb8eeaf425d8abff84344e38d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:40.596530 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.597181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.598758 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1316/2625] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:40 2022] DELETE /identity/v3/projects/ace75fb8eeaf425d8abff84344e38d00 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:40.602678 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:40.613000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb615-b023-4dff-b568-66771b707d0a service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:40.667144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:40.668115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:40.668396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:40.668665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] PATH_INFO: `/v3/users/825abdd983324ce182241e46031073d4` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:40.669827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825abdd983324ce182241e46031073d4)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:40.671784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:40.714954 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825abdd983324ce182241e46031073d4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.725878 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825abdd983324ce182241e46031073d4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.732659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825abdd983324ce182241e46031073d4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.733284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825abdd983324ce182241e46031073d4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.740999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-7c515f2a-a509-4f0c-952e-864bf366fd07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825abdd983324ce182241e46031073d4'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:40.746923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1310/2626] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:40 2022] DELETE /identity/v3/users/825abdd983324ce182241e46031073d4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:41.004640 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.006103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:41.019986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84924f3-4108-4229-86c7-07306f3bbff2 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.077172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.078030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.078312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.078588 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] PATH_INFO: `/v3/projects/397df6e3477641858a6882822298b815` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.079892 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397df6e3477641858a6882822298b815)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.081885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.125373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397df6e3477641858a6882822298b815', 'request_id': 'req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:41.131986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397df6e3477641858a6882822298b815', 'request_id': 'req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:41.137143 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397df6e3477641858a6882822298b815', 'request_id': 'req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:41.148229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] The token cache is being invalidate because project 397df6e3477641858a6882822298b815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:41.148513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:41.149127 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-33eb07eb-310b-4cbe-ab01-c1a5bbe50607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:41.150775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1317/2627] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:41 2022] DELETE /identity/v3/projects/397df6e3477641858a6882822298b815 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:41.155628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.155921 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.156202 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.173772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:41.175001 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:41.232341 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1311/2628] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:41.241276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.241569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.241852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.259597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:41.260793 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:41.269326 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1318/2629] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:41.273590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.284027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4db7-76ee-4609-940e-d251f8668790 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.289141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.289407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.289694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.289974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.290701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:52:41.291012 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.292644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.307299 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1312/2630] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:52:41.308427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.317762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb116-c9cb-4e19-8cf2-a52d30851dde None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.322390 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.323058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.323375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.323661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.324370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.326256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.352412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1319/2631] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:41.356503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.366657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf915-3257-4ef1-aa72-7079918bf1ca admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.430371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.431243 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.431538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.431876 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.432594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.434553 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.454216 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1313/2632] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:41.458629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.468987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473007-a709-4ab3-b12c-50bd6178008f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.474625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.475325 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.475607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.475882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.476609 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.478197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.488370 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1320/2633] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:41.492337 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.502760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e03c3-06f5-4bf3-a52c-8e78500776ad admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.508097 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff469aa8-ccdc-4bc5-9b4f-675d5c340a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.508778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469aa8-ccdc-4bc5-9b4f-675d5c340a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.509062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469aa8-ccdc-4bc5-9b4f-675d5c340a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.509388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469aa8-ccdc-4bc5-9b4f-675d5c340a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.510218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff469aa8-ccdc-4bc5-9b4f-675d5c340a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.511877 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff469aa8-ccdc-4bc5-9b4f-675d5c340a66 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.522778 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1314/2634] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:41.526707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.536463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee854c-bc2b-4cf1-8157-f1000814dadb admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.541071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.541942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.542230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.542511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] PATH_INFO: `/v3/projects/939aa64ffacc4b7aa2f59d993278b2dd/users/acf6bedcf3754ecc9de764b02a41d7d0/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.556484 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] RBAC: Authorizing `identity:create_grant(project_id=939aa64ffacc4b7aa2f59d993278b2dd, user_id=acf6bedcf3754ecc9de764b02a41d7d0, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.559205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.572066 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1321/2635] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:41 2022] PUT /identity/v3/projects/939aa64ffacc4b7aa2f59d993278b2dd/users/acf6bedcf3754ecc9de764b02a41d7d0/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:41.582786 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.583077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.583395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.608842 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] MFA Rules not processed for user `acf6bedcf3754ecc9de764b02a41d7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:41.610051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:41.672454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1315/2636] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:41.676770 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.735076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bd173-4723-4c5c-8c51-c98e6e16098f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.739668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.740313 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.740599 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.740875 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.741548 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.743492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.767130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1322/2637] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:41.772047 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.782637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccac82-f2bb-4aec-b8e7-29823dd31d3b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.836193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.836853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.837141 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.837420 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.838116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.840071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.858142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1316/2638] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:41 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:41.862713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.872829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331a15-187f-4ef5-9c71-a715c92891e5 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.878191 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.878855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.879187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.879476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.880203 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.881811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.892492 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1323/2639] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:41.896514 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.906064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d3da-5e3f-4ead-816d-07cffe362262 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:41.910694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:41.911614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:41.911902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:41.912184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] PATH_INFO: `/v3/projects/1c205a789e2d40088833c24c7c449d05/users/1373d67c7e284453be367b5866c1f230/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:41.926836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c205a789e2d40088833c24c7c449d05, user_id=1373d67c7e284453be367b5866c1f230, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:41.929520 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:41.942185 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1317/2640] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:41 2022] PUT /identity/v3/projects/1c205a789e2d40088833c24c7c449d05/users/1373d67c7e284453be367b5866c1f230/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:41.946262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:41.956062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99cd1a-a740-4422-b8ed-b235e560b11c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:42.010199 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b5c81-ff36-428f-aed4-27100e3b92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:42.010860 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5c81-ff36-428f-aed4-27100e3b92dd admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:42.011166 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5c81-ff36-428f-aed4-27100e3b92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:42.011445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5c81-ff36-428f-aed4-27100e3b92dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:42.012160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b5c81-ff36-428f-aed4-27100e3b92dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:42.013735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b5c81-ff36-428f-aed4-27100e3b92dd admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:42.023253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1324/2641] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:42.027933 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:42.037951 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b1f58-466d-4192-8fb6-adbe758c87e1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:42.042875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:42.043814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:42.044057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:42.044327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] PATH_INFO: `/v3/projects/1c205a789e2d40088833c24c7c449d05/users/1373d67c7e284453be367b5866c1f230/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:42.046276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c205a789e2d40088833c24c7c449d05, user_id=1373d67c7e284453be367b5866c1f230, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:42.049427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:42.059370 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1318/2642] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:42 2022] PUT /identity/v3/projects/1c205a789e2d40088833c24c7c449d05/users/1373d67c7e284453be367b5866c1f230/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:52:42.070098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:42.070385 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:42.070665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:42.095814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] MFA Rules not processed for user `1373d67c7e284453be367b5866c1f230`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:42.097002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:42.162433 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1325/2643] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:42.172806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:42.175006 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:42.229775 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f573a1-2108-4434-931d-3885e237c531 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:42.233338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797da6-9259-452e-aecb-d65ab0d1a727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:42.233973 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797da6-9259-452e-aecb-d65ab0d1a727 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:42.234262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797da6-9259-452e-aecb-d65ab0d1a727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:42.234544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797da6-9259-452e-aecb-d65ab0d1a727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:42.288305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797da6-9259-452e-aecb-d65ab0d1a727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:42.289748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797da6-9259-452e-aecb-d65ab0d1a727 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:42.298427 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1319/2644] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:46.440964 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:46.442377 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:46.454151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe43a-b626-4679-aee3-c1a5ac0efd75 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:46.457840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:46.458581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:46.458933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:46.459314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:46.468837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:46.470283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:46.479622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1326/2645] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:49.768656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:49.769168 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:49.769288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:49.786908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] MFA Rules not processed for user `0fbecbaf1c2c4caf8ccd3a3f5dd3c9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:49.788137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:49.839508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1320/2646] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:49.873994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:49.875400 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:49.929501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44082-8056-44bd-a072-61e69f9ee517 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:49.933014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:49.933650 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:49.933933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:49.934209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:49.935952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:50.002602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:50.004019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:50.014849 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1327/2647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:50.774132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:50.775661 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:50.833971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578569b-cddb-4df7-8715-d913e1fc47f8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:50.837582 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:50.838241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:50.838625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:50.838909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:50.840733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:50.856251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:50.858099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d257757-7697-4388-b80a-813d4d425768 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:50.871747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1321/2648] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:51.314826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:51.375598 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8358-787a-4a97-a169-bb20c11bc39a service glance] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:51.380046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:51.380917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:51.381200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:51.381476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] PATH_INFO: `/v3/users/acf6bedcf3754ecc9de764b02a41d7d0` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:51.382643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf6bedcf3754ecc9de764b02a41d7d0)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:51.384578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:51.428131 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf6bedcf3754ecc9de764b02a41d7d0'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:51.439570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf6bedcf3754ecc9de764b02a41d7d0'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:51.446950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf6bedcf3754ecc9de764b02a41d7d0'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:51.447643 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf6bedcf3754ecc9de764b02a41d7d0'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:51.448256 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf6bedcf3754ecc9de764b02a41d7d0'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:51.461065 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1328/2649] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:51 2022] DELETE /identity/v3/users/acf6bedcf3754ecc9de764b02a41d7d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:51.465747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:51.466054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:51.466371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:51.486643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:51.488048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:51.546074 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1322/2650] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:51.556308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:51.557691 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:51.612898 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63560376-77cd-4c1a-a070-90d079706bf3 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:51.616683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:51.617363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:51.617644 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:51.617923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:51.627060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:51.628431 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:51.638187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1329/2651] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:51.926836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:51.932033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:51.951140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea481e5-4650-4b8f-9071-b59858cd89cc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:51.958467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:51.959971 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:51.960320 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:51.960875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] PATH_INFO: `/v3/projects/939aa64ffacc4b7aa2f59d993278b2dd` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:51.962454 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] RBAC: Authorizing `identity:delete_project(project_id=939aa64ffacc4b7aa2f59d993278b2dd)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:51.964781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.016073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939aa64ffacc4b7aa2f59d993278b2dd', 'request_id': 'req-be09309c-eb14-4145-8f4e-4315189f909d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.025287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939aa64ffacc4b7aa2f59d993278b2dd', 'request_id': 'req-be09309c-eb14-4145-8f4e-4315189f909d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.032375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939aa64ffacc4b7aa2f59d993278b2dd', 'request_id': 'req-be09309c-eb14-4145-8f4e-4315189f909d'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.047733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] The token cache is being invalidate because project 939aa64ffacc4b7aa2f59d993278b2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:52.048079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.048845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.050982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1323/2652] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:51 2022] DELETE /identity/v3/projects/939aa64ffacc4b7aa2f59d993278b2dd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:52.054953 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.064534 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c42e3-af71-4442-989b-85bb2510b8ba service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.121299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.122337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.122626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.122902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] PATH_INFO: `/v3/users/1373d67c7e284453be367b5866c1f230` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.124129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1373d67c7e284453be367b5866c1f230)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.126038 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.173268 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1373d67c7e284453be367b5866c1f230'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.184973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1373d67c7e284453be367b5866c1f230'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.192809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1373d67c7e284453be367b5866c1f230'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.193427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1373d67c7e284453be367b5866c1f230'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.194019 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-809fd053-301d-4fd3-81b8-d3a2e634c286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1373d67c7e284453be367b5866c1f230'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.205756 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1330/2653] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:52 2022] DELETE /identity/v3/users/1373d67c7e284453be367b5866c1f230 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:52.472860 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.474568 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:52.490926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09309c-eb14-4145-8f4e-4315189f909d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.550990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.552453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.552743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.553021 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] PATH_INFO: `/v3/projects/1c205a789e2d40088833c24c7c449d05` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.554268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c205a789e2d40088833c24c7c449d05)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.556232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.601210 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c205a789e2d40088833c24c7c449d05', 'request_id': 'req-9f518a41-db5a-455b-9116-ab5391f4d0ed'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.608740 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c205a789e2d40088833c24c7c449d05', 'request_id': 'req-9f518a41-db5a-455b-9116-ab5391f4d0ed'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.614482 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c205a789e2d40088833c24c7c449d05', 'request_id': 'req-9f518a41-db5a-455b-9116-ab5391f4d0ed'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.625035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] The token cache is being invalidate because project 1c205a789e2d40088833c24c7c449d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:52.625318 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.625947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-9f518a41-db5a-455b-9116-ab5391f4d0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:52.627532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1324/2654] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:52 2022] DELETE /identity/v3/projects/1c205a789e2d40088833c24c7c449d05 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:52.634469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.634965 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.635052 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.652564 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:52.653698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:52.711633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1331/2655] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:52.721667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.721953 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.722752 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.741228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:52.742417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:52.750277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1325/2656] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:52.754563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.763899 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755113a-50d7-4795-bfbd-2c7efdda7bbd None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.768496 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.769181 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.769463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.769990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.770710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:52:52.771016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.772632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.784207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1332/2657] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:52:52.789094 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.798497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0ae11-5450-42ca-8b79-f52cb828128a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.803886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.804613 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.804982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.805328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.806089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.808215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.833927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1326/2658] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:52 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:52.838106 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.849089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacdbb-2c05-440c-abaa-eb1766bac564 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.906885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.907601 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.907957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.908302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.909107 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.911658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.935626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1333/2659] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:52 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:52:52.936886 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.947009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e405f2-a2c7-4297-a56a-bfbda439eea8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.951914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.952583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.952867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.953146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.953910 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.955724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.966667 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1327/2660] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:52.970519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:52.980824 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0c4b3-89ce-4f1e-92e4-3f4ff7b9c49b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:52.985491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7aae-530e-49fc-b2c6-8d5cec8cde20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:52.986154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7aae-530e-49fc-b2c6-8d5cec8cde20 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:52.986441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7aae-530e-49fc-b2c6-8d5cec8cde20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:52.986720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7aae-530e-49fc-b2c6-8d5cec8cde20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:52.987482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d7aae-530e-49fc-b2c6-8d5cec8cde20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:52.989903 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d7aae-530e-49fc-b2c6-8d5cec8cde20 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:52.999683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1334/2661] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:53.003716 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:53.013472 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23691d-7c56-4770-9a30-a63a7aebbaef admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:53.018143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:53.019019 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:53.019319 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:53.020026 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] PATH_INFO: `/v3/projects/71c65d7e4d2b480c993dc72ca2757d14/users/3aae938ba2ff4231bc380b9ce136110d/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:53.035371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c65d7e4d2b480c993dc72ca2757d14, user_id=3aae938ba2ff4231bc380b9ce136110d, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:53.039493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:53.056609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1328/2662] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:53 2022] PUT /identity/v3/projects/71c65d7e4d2b480c993dc72ca2757d14/users/3aae938ba2ff4231bc380b9ce136110d/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:53.068144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970712-129a-432e-93d3-531481a30074 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:53.068612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970712-129a-432e-93d3-531481a30074 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:53.068987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970712-129a-432e-93d3-531481a30074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:53.120882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-fb970712-129a-432e-93d3-531481a30074 None None] MFA Rules not processed for user `3aae938ba2ff4231bc380b9ce136110d`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:53.120882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-fb970712-129a-432e-93d3-531481a30074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:53.191195 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1335/2663] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:53.198597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:53.200308 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:53.263896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c6bf1-921d-4642-94bf-f5b87be72cd2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:53.267679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9441d6d-4bd8-446e-bdbc-2abe40c7f3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:53.268363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9441d6d-4bd8-446e-bdbc-2abe40c7f3ac service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:53.268650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9441d6d-4bd8-446e-bdbc-2abe40c7f3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:53.268932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9441d6d-4bd8-446e-bdbc-2abe40c7f3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:53.278312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9441d6d-4bd8-446e-bdbc-2abe40c7f3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:53.279868 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9441d6d-4bd8-446e-bdbc-2abe40c7f3ac service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:53.289506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1329/2664] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:55.821472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970712-129a-432e-93d3-531481a30074 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:55.886730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970712-129a-432e-93d3-531481a30074 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:55.892179 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:55.893580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:55.893852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:55.894122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] PATH_INFO: `/v3/users/3aae938ba2ff4231bc380b9ce136110d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:55.895673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aae938ba2ff4231bc380b9ce136110d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:55.898310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:55.951708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aae938ba2ff4231bc380b9ce136110d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:55.964125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aae938ba2ff4231bc380b9ce136110d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:55.972269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aae938ba2ff4231bc380b9ce136110d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:55.973470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aae938ba2ff4231bc380b9ce136110d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:55.974161 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aae938ba2ff4231bc380b9ce136110d'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:55.990439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1336/2665] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:52:55 2022] DELETE /identity/v3/users/3aae938ba2ff4231bc380b9ce136110d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:55.992217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:55.992653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:55.992784 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.009655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:56.010869 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:56.073529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1330/2666] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:56.083573 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.085022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:56.139945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113a910-ba65-4c2f-b3bc-563414202180 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.143869 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b8dd1-a9dd-47a5-b17a-a3605fe47159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.144515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b8dd1-a9dd-47a5-b17a-a3605fe47159 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.145563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b8dd1-a9dd-47a5-b17a-a3605fe47159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.145842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b8dd1-a9dd-47a5-b17a-a3605fe47159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.154846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b8dd1-a9dd-47a5-b17a-a3605fe47159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.156303 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b8dd1-a9dd-47a5-b17a-a3605fe47159 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.166298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1337/2667] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:52:56.423071 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.424657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:56.439147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396b9ea-c6e2-4202-8c02-5442677d0d80 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.442393 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.443429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.443781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.444124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] PATH_INFO: `/v3/projects/71c65d7e4d2b480c993dc72ca2757d14` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.445406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c65d7e4d2b480c993dc72ca2757d14)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.447437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.495760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c65d7e4d2b480c993dc72ca2757d14', 'request_id': 'req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:56.502852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c65d7e4d2b480c993dc72ca2757d14', 'request_id': 'req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:56.508845 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c65d7e4d2b480c993dc72ca2757d14', 'request_id': 'req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:56.519343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] The token cache is being invalidate because project 71c65d7e4d2b480c993dc72ca2757d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:52:56.519631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:56.521154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-8fd08cd2-56d9-45d4-92e0-94ec69f67d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:52:56.522702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1331/2668] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:52:56 2022] DELETE /identity/v3/projects/71c65d7e4d2b480c993dc72ca2757d14 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:56.527680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.527970 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.528248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.546091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:56.547336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:56.604590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1338/2669] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:56.612332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.612623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.612901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.630731 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:56.631947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:56.639687 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1332/2670] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:52:56.643622 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.654063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a22d-06c4-450a-bc24-b445a7118ebc None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.658818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.659509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.659796 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.660074 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.660841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:52:56.661148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.662730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.674169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1339/2671] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:52:56.678377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.687408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bc375-91c6-4909-991e-0e8cf32ca1d2 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.692556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.693200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.693483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.693761 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.694457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.696395 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.722289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1333/2672] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:52:56 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:56.726448 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.736253 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69a38a-6dee-47a4-8cc2-08d5f5a1b3f8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.792151 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.792972 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.793261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.793539 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.794226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.796160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.815789 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1340/2673] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:52:56 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:52:56.820496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.830477 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71ef89-9557-430d-8844-5cb66db78697 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.835007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.835704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.835990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.836271 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.836990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.838590 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.849554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1334/2674] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:56.853258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.862859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795473ae-9e10-40c5-b4ef-1b96b2076fe6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.867859 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcea4b-02f4-4d69-92c1-0bd715d774a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.868505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcea4b-02f4-4d69-92c1-0bd715d774a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.868790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcea4b-02f4-4d69-92c1-0bd715d774a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.869063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcea4b-02f4-4d69-92c1-0bd715d774a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.869778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcea4b-02f4-4d69-92c1-0bd715d774a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.871379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcea4b-02f4-4d69-92c1-0bd715d774a4 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.881587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1341/2675] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:52:56.886896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:56.897063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6f81d-b9d3-4bcb-b8f8-ab8997ae03be admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:56.901615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:56.902488 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.902771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.903049 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] PATH_INFO: `/v3/projects/063221e7b7bd455c83c27ce6a4ce0804/users/836486a6b993438f90f2fe7f87c95b67/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.917035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063221e7b7bd455c83c27ce6a4ce0804, user_id=836486a6b993438f90f2fe7f87c95b67, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:56.919763 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:56.932757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1335/2676] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:52:56 2022] PUT /identity/v3/projects/063221e7b7bd455c83c27ce6a4ce0804/users/836486a6b993438f90f2fe7f87c95b67/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:52:56.942422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf14ec7-0903-45ef-8b2a-27ee047c59ac None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:56.942721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf14ec7-0903-45ef-8b2a-27ee047c59ac None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:56.943003 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf14ec7-0903-45ef-8b2a-27ee047c59ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:56.968839 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-6bf14ec7-0903-45ef-8b2a-27ee047c59ac None None] MFA Rules not processed for user `836486a6b993438f90f2fe7f87c95b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:52:56.970033 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-6bf14ec7-0903-45ef-8b2a-27ee047c59ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:57.031028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1342/2677] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:52:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:52:57.041392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:52:57.043060 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:52:57.099783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a75521-940d-4996-a483-fb29cf899c32 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:52:57.103412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:52:57.104058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:52:57.104342 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:52:57.104627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:52:57.112848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:52:57.114780 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:52:57.123548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1336/2678] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:52:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:04.130976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:04.131713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:04.131713 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:04.150278 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:04.151762 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:04.208712 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1343/2679] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:04.229278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:04.230750 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:04.305821 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ee1cd-1c9d-46fa-a079-e4fdb604480d service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:04.313657 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4d86a-9b03-4869-88bb-e44da1e55534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:04.314621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d86a-9b03-4869-88bb-e44da1e55534 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:04.315053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d86a-9b03-4869-88bb-e44da1e55534 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:04.315525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d86a-9b03-4869-88bb-e44da1e55534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:04.328250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4d86a-9b03-4869-88bb-e44da1e55534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:04.330813 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4d86a-9b03-4869-88bb-e44da1e55534 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:04.343712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1337/2680] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:06.761811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:06.771517 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dabe46-24c5-44c1-bbcd-25a16b785f9c None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:06.776080 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:06.776951 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:06.777236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:06.777542 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] PATH_INFO: `/v3/users/836486a6b993438f90f2fe7f87c95b67` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:06.778727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836486a6b993438f90f2fe7f87c95b67)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:06.780680 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:06.825272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836486a6b993438f90f2fe7f87c95b67'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:06.836270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836486a6b993438f90f2fe7f87c95b67'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:06.843062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836486a6b993438f90f2fe7f87c95b67'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:06.843731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836486a6b993438f90f2fe7f87c95b67'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:06.844336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836486a6b993438f90f2fe7f87c95b67'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:06.856589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1344/2681] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:06 2022] DELETE /identity/v3/users/836486a6b993438f90f2fe7f87c95b67 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:06.861064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:06.861558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:06.861662 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:06.878620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:06.879855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:06.945896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1338/2682] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:06.955410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:06.956856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:07.011938 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3af5-5109-4d5e-973c-430c4d1175c8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:07.015587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:07.016232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:07.016520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:07.016795 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:07.026329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:07.027799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:07.037011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1345/2683] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:07.299862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:07.301397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:07.317083 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c899f-b8b5-4ed5-9921-e5ed70e9dc7c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:07.322100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:07.323614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:07.323614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:07.323614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] PATH_INFO: `/v3/projects/063221e7b7bd455c83c27ce6a4ce0804` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:07.324804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063221e7b7bd455c83c27ce6a4ce0804)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:07.326791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:07.370521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063221e7b7bd455c83c27ce6a4ce0804', 'request_id': 'req-a8765101-579c-410e-ac3a-b7f437c540c2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:07.377610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063221e7b7bd455c83c27ce6a4ce0804', 'request_id': 'req-a8765101-579c-410e-ac3a-b7f437c540c2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:07.383494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063221e7b7bd455c83c27ce6a4ce0804', 'request_id': 'req-a8765101-579c-410e-ac3a-b7f437c540c2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:07.393792 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] The token cache is being invalidate because project 063221e7b7bd455c83c27ce6a4ce0804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:07.394075 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:07.394693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a8765101-579c-410e-ac3a-b7f437c540c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:07.396479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1339/2684] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:07 2022] DELETE /identity/v3/projects/063221e7b7bd455c83c27ce6a4ce0804 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:08.831146 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:08.833570 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:08.944948 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed950b-5275-4ccb-9699-e13bd12136e2 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:09.029786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:09.030563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:09.030921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:09.031372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:09.033469 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:09.048535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:09.050002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:09.062404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1346/2685] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:09.413934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:09.414916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:09.415287 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:09.435640 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:09.436843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:09.502686 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1340/2686] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:09.524051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:09.525523 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:09.547324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4152-2175-4529-9085-9378fd3b535a service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:09.553437 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9d3df-2889-4d6d-83e3-c93ec23fb268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:09.554101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d3df-2889-4d6d-83e3-c93ec23fb268 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:09.554381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d3df-2889-4d6d-83e3-c93ec23fb268 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:09.554709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d3df-2889-4d6d-83e3-c93ec23fb268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:09.563806 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9d3df-2889-4d6d-83e3-c93ec23fb268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:09.565389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9d3df-2889-4d6d-83e3-c93ec23fb268 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:09.576005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1347/2687] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:11.661592 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:11.663030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:11.718936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791889ad-2f58-4d93-927d-ff57f12bf8cc None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:11.722656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:11.723334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:11.723621 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:11.723900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:11.725655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:11.801837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:11.803309 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:11.821810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1341/2688] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:12.481776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:12.482231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:12.482333 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:12.500100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:12.501279 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:12.509729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1348/2689] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:12.529743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:12.531178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:12.546990 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38861809-01b2-47bb-a630-5479b4925147 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:12.552453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45594031-7428-49c1-be40-b52d716b75f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:12.553125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45594031-7428-49c1-be40-b52d716b75f9 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:12.554042 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45594031-7428-49c1-be40-b52d716b75f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:12.554323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45594031-7428-49c1-be40-b52d716b75f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:12.562304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45594031-7428-49c1-be40-b52d716b75f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:12.563914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45594031-7428-49c1-be40-b52d716b75f9 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:12.573200 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1342/2690] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:14.344331 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:14.345704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:14.399516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c18ed-1e54-42d0-8561-6d6922c3d0b0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:14.402994 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:14.403662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:14.403950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:14.404218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:14.405945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:14.418886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:14.420426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:14.430916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1349/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:16.674982 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:16.675625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:16.675625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:16.700051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:16.701193 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:16.710143 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1343/2692] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:16.734497 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:16.748232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774fab-33ed-45f4-806a-5b6c93a267fb service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:16.753707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:16.754426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:16.754908 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:16.755216 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:16.764020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:16.765597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:16.778013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1350/2693] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:17.562949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:17.564382 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:17.577153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee56d-5f45-431b-ad46-6c522216a708 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:17.581630 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:17.582523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:17.582927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:17.583268 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] PATH_INFO: `/v3/users/7f0abeff2be84d51854bd3231864669e` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:17.585020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0abeff2be84d51854bd3231864669e)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:17.586952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:17.632226 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0abeff2be84d51854bd3231864669e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.643312 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0abeff2be84d51854bd3231864669e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.650707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0abeff2be84d51854bd3231864669e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.651360 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0abeff2be84d51854bd3231864669e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.658307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-35e491e3-4798-4f18-9717-ce4a7f341383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0abeff2be84d51854bd3231864669e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.664609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1344/2694] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:17 2022] DELETE /identity/v3/users/7f0abeff2be84d51854bd3231864669e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:17.824787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:17.838750 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f97b-be73-40f0-8070-5f3fab4bc0e7 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:17.893725 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:17.894586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:17.894866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:17.895418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] PATH_INFO: `/v3/projects/6830d25b09a549f8849db04c1632c4d6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:17.896578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6830d25b09a549f8849db04c1632c4d6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:17.899096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:17.941224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6830d25b09a549f8849db04c1632c4d6', 'request_id': 'req-823196a4-6fc5-4e0d-9bfa-026c118a3345'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.948491 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6830d25b09a549f8849db04c1632c4d6', 'request_id': 'req-823196a4-6fc5-4e0d-9bfa-026c118a3345'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.953797 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6830d25b09a549f8849db04c1632c4d6', 'request_id': 'req-823196a4-6fc5-4e0d-9bfa-026c118a3345'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.964654 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] The token cache is being invalidate because project 6830d25b09a549f8849db04c1632c4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:17.964935 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.965543 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-823196a4-6fc5-4e0d-9bfa-026c118a3345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:17.967057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1351/2695] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:17 2022] DELETE /identity/v3/projects/6830d25b09a549f8849db04c1632c4d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:17.972181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:17.972668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:17.972764 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:17.991404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:17.992593 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:18.050748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1345/2696] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:18.059267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.059566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.059879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.078071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:18.079297 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:18.087744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1352/2697] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:18.091863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.101145 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2e3bd-8950-4d64-925f-70400b7c7bb6 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.105580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.106219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.106498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.106772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.107527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:18.107828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.109413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.120471 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1346/2698] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:53:18.124537 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.133936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4f547-8c1d-4167-8e40-62e41ef2c749 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.138606 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.139295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.139586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.139862 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.140583 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.142499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.175100 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1353/2699] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:18 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:18.176583 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.186767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3860b-bd22-4fe4-96fb-f97e79caf1a1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.238697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.239383 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.239668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.239943 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.241150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.243064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.262491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1347/2700] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:18 2022] POST /identity/v3/users => generated 284 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:18.266536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.277050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e98145-b86b-47a6-809a-29bf01621169 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.281630 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.282291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.282578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.282858 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.283626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.285236 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.295402 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1354/2701] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:18.299050 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.309235 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449513-4237-4059-a33a-48cd27e8069c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.313725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789af51-6c9e-4931-94d0-543662f1df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.314366 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789af51-6c9e-4931-94d0-543662f1df6e admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.314650 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789af51-6c9e-4931-94d0-543662f1df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.314927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789af51-6c9e-4931-94d0-543662f1df6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.315674 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789af51-6c9e-4931-94d0-543662f1df6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.317281 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789af51-6c9e-4931-94d0-543662f1df6e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.327369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1348/2702] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:18.331248 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.342330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323894bb-751b-4220-9eb2-aff28fbb7fc1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.347046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.347977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.348261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.348536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] PATH_INFO: `/v3/projects/4f16a3ea00944d7386ae28d676a40d10/users/ac3791cd5d6c4e07ab3f70c7c4fdcd09/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.363841 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f16a3ea00944d7386ae28d676a40d10, user_id=ac3791cd5d6c4e07ab3f70c7c4fdcd09, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.367030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.379676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1355/2703] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:18 2022] PUT /identity/v3/projects/4f16a3ea00944d7386ae28d676a40d10/users/ac3791cd5d6c4e07ab3f70c7c4fdcd09/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:18.390537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631661ea-8b6b-4d59-a009-f3d8943a67b5 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.390891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631661ea-8b6b-4d59-a009-f3d8943a67b5 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.391219 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631661ea-8b6b-4d59-a009-f3d8943a67b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.417036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-631661ea-8b6b-4d59-a009-f3d8943a67b5 None None] MFA Rules not processed for user `ac3791cd5d6c4e07ab3f70c7c4fdcd09`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:18.418244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-631661ea-8b6b-4d59-a009-f3d8943a67b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:18.481919 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1349/2704] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:18.493290 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:18.495250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:18.551403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ec92-eadc-4de4-a35a-aac31d405724 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:18.556139 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:18.557086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:18.557388 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:18.557766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:18.566625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:18.568072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:18.576776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1356/2705] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:20.910396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:20.910967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:20.910967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:20.931445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:20.933206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:20.993321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1350/2706] 10.222.0.60 () {58 vars in 1016 bytes} [Fri Apr 29 18:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:21.014521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:21.016085 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:21.089973 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842da73-c8de-4439-b5e9-8cfca7d75c20 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:21.098207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:21.098982 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:21.099350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:21.099639 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:21.108837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:21.110396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:21.121651 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1357/2707] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:22.112758 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:22.125855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7bf93-5c42-4798-b2c4-070df4e0c783 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:22.132325 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:22.132965 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:22.133249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:22.133523 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:22.135357 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:22.213544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:22.215166 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fce21-9dec-47bf-a354-fabe27cda6fa service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:22.236124 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1351/2708] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:26.797735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:26.808558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f61411-bc9d-4d3d-89f8-08f992b16530 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:26.813535 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:26.814359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:26.814754 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:26.815022 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] PATH_INFO: `/v3/users/ac3791cd5d6c4e07ab3f70c7c4fdcd09` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:26.816538 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3791cd5d6c4e07ab3f70c7c4fdcd09)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:26.818800 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:26.868785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3791cd5d6c4e07ab3f70c7c4fdcd09'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:26.880304 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3791cd5d6c4e07ab3f70c7c4fdcd09'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:26.887580 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3791cd5d6c4e07ab3f70c7c4fdcd09'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:26.888207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3791cd5d6c4e07ab3f70c7c4fdcd09'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:26.888808 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3791cd5d6c4e07ab3f70c7c4fdcd09'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:26.900818 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1358/2709] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:26 2022] DELETE /identity/v3/users/ac3791cd5d6c4e07ab3f70c7c4fdcd09 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:26.906041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:26.906616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:26.906757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:26.926020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:26.927743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:27.000942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1352/2710] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:27.010581 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.012077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:27.074150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18bfe-c4b6-43cd-bad3-d27cfb1fd95e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.077826 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674474c-59f0-486b-8379-22e701fd89a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.078481 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674474c-59f0-486b-8379-22e701fd89a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.078769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674474c-59f0-486b-8379-22e701fd89a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.079049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674474c-59f0-486b-8379-22e701fd89a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.088078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674474c-59f0-486b-8379-22e701fd89a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.089513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674474c-59f0-486b-8379-22e701fd89a7 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.099055 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1359/2711] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:27.364231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.365834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:27.380036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977400-2e87-4d9a-937f-77a69027fc0b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.384909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.385782 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.386064 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.386340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] PATH_INFO: `/v3/projects/4f16a3ea00944d7386ae28d676a40d10` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.387604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f16a3ea00944d7386ae28d676a40d10)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.389473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.438773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f16a3ea00944d7386ae28d676a40d10', 'request_id': 'req-bff18d46-7da2-47db-83bd-b6e4b7e101e0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:27.446760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f16a3ea00944d7386ae28d676a40d10', 'request_id': 'req-bff18d46-7da2-47db-83bd-b6e4b7e101e0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:27.453607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f16a3ea00944d7386ae28d676a40d10', 'request_id': 'req-bff18d46-7da2-47db-83bd-b6e4b7e101e0'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:27.465028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] The token cache is being invalidate because project 4f16a3ea00944d7386ae28d676a40d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:27.465215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:27.465864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bff18d46-7da2-47db-83bd-b6e4b7e101e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:27.467462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1353/2712] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:27 2022] DELETE /identity/v3/projects/4f16a3ea00944d7386ae28d676a40d10 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:27.472336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.472625 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.472902 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.490694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:27.491924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:27.552200 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1360/2713] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:27.560209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.560741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.561029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.579413 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:27.580617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:27.590942 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1354/2714] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:27.595058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.604785 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf868-e244-47f8-b6fc-dcb9aeceb0ef None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.609479 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.610138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.610426 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.610708 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.611508 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:27.611825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.613429 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.624915 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1361/2715] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:53:27.628830 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.638466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81087dfc-3e49-457c-9e40-6a1ade3020df None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.643263 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.643906 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.644190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.644467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.645429 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.648009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.672739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1355/2716] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:27 2022] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:27.676829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.686635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedfb25-a6b6-4709-a046-0128de312265 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.741275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.741968 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.742225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.742502 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.743246 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.745162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.763281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1362/2717] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:27 2022] POST /identity/v3/users => generated 305 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:27.767423 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.778248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b71c-7752-4198-ba35-7f0ea68eb5de admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.782986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.783757 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.784044 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.784316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.785030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.786676 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.797501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1356/2718] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:27.801312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.811148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65afa6b-7530-482e-bd45-1cafabd65cc1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.815702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7eebd2-e256-4cdc-806e-f8ee48c411ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.816362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eebd2-e256-4cdc-806e-f8ee48c411ff admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.816652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eebd2-e256-4cdc-806e-f8ee48c411ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.816937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eebd2-e256-4cdc-806e-f8ee48c411ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.817697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7eebd2-e256-4cdc-806e-f8ee48c411ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.819813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7eebd2-e256-4cdc-806e-f8ee48c411ff admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.829458 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1363/2719] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:27.835978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:27.845995 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ddb06-bfeb-497b-a9e9-92489f4c0c86 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:27.850509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:27.851447 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.851725 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.851999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] PATH_INFO: `/v3/projects/834355b661174ab790dc87d1a81cb6a2/users/ab06ba20ee4e47b7b957770c48bf5a6f/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.866334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=834355b661174ab790dc87d1a81cb6a2, user_id=ab06ba20ee4e47b7b957770c48bf5a6f, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:27.869132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:27.882345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1357/2720] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:27 2022] PUT /identity/v3/projects/834355b661174ab790dc87d1a81cb6a2/users/ab06ba20ee4e47b7b957770c48bf5a6f/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:27.892590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:27.892889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:27.893197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:27.920765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] MFA Rules not processed for user `ab06ba20ee4e47b7b957770c48bf5a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:27.921990 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:27.988989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1364/2721] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:27.994010 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.056009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce515c89-f01d-4d02-9a31-fc5477ff4ecd admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.060710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.061353 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.061638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.061916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.062638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.064616 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.089224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1358/2722] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:27 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:28.093274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.103769 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241b6b5-a630-4ac2-8e3d-f1f30592b58f None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.160091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.160912 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.161301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.161603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.162501 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.164566 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.186553 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1365/2723] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:28 2022] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:28.190696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.201334 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62898f-077c-4de3-a87c-d79cc2cf164c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.205903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.206549 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.206833 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.207125 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.207855 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.209443 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.219607 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1359/2724] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:28.223657 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.235025 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879809a3-224b-45bc-b91c-3f395bdabbf7 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.241237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.242119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.242402 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.242676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] PATH_INFO: `/v3/projects/ca5d7e4cefbd46b3b1c1e6962aeb5c6c/users/ce6cfb71160b4f2cb49f5a2850d72b8e/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.258666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5d7e4cefbd46b3b1c1e6962aeb5c6c, user_id=ce6cfb71160b4f2cb49f5a2850d72b8e, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.261362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.276193 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1366/2725] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:28 2022] PUT /identity/v3/projects/ca5d7e4cefbd46b3b1c1e6962aeb5c6c/users/ce6cfb71160b4f2cb49f5a2850d72b8e/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:28.280215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.290414 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171532c6-b044-4e95-81c5-54a8d18f590a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.343277 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aae85-8cd6-4109-82bd-2846769780b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.343956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aae85-8cd6-4109-82bd-2846769780b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.344241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aae85-8cd6-4109-82bd-2846769780b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.344519 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aae85-8cd6-4109-82bd-2846769780b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.345247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aae85-8cd6-4109-82bd-2846769780b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.346863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aae85-8cd6-4109-82bd-2846769780b2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.357139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1360/2726] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:28.361494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.373077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57294d8-0fe3-4ff1-9dab-892ab79e8f3d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.377777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.378673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.378945 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.379254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] PATH_INFO: `/v3/projects/ca5d7e4cefbd46b3b1c1e6962aeb5c6c/users/ce6cfb71160b4f2cb49f5a2850d72b8e/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.381185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5d7e4cefbd46b3b1c1e6962aeb5c6c, user_id=ce6cfb71160b4f2cb49f5a2850d72b8e, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.383917 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.394355 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1367/2727] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:28 2022] PUT /identity/v3/projects/ca5d7e4cefbd46b3b1c1e6962aeb5c6c/users/ce6cfb71160b4f2cb49f5a2850d72b8e/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:28.405015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.405302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.405577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.433419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] MFA Rules not processed for user `ce6cfb71160b4f2cb49f5a2850d72b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:28.434733 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:28.507768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1361/2728] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:28.518183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.519909 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:28.577247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efbebe-5a6f-4e07-a6ca-d2ae8052ce4f admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.580933 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.581652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.581873 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.582148 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.591957 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.593384 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.603697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1368/2729] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:28.749418 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:28.759099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055bf68-f88e-4fd2-924b-900606647763 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:28.762677 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:28.763347 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:28.763632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:28.763907 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:28.817894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:28.819384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:28.827952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1362/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:29.129315 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:29.130799 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:29.189219 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090ef8c-04bf-4615-beaa-4cbbb4dcae46 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:29.192779 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:29.193931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:29.194218 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:29.194493 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:29.196272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:29.255886 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:29.257853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:29.267207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1369/2731] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:32.618305 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:32.619994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:32.634595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115a9df-bdb0-41e0-b586-646c0fd92594 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:32.639142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:32.640198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:32.640554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:32.640834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] PATH_INFO: `/v3/users/c9a4f5ac438741bcad2867f46c4dfaeb` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:32.642034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a4f5ac438741bcad2867f46c4dfaeb)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:32.644262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:32.690203 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a4f5ac438741bcad2867f46c4dfaeb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:32.702183 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a4f5ac438741bcad2867f46c4dfaeb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:32.710008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a4f5ac438741bcad2867f46c4dfaeb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:32.710631 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a4f5ac438741bcad2867f46c4dfaeb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:32.717820 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-77526929-50e0-41f9-925e-8c7f932de090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a4f5ac438741bcad2867f46c4dfaeb'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:32.724375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1363/2732] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:32 2022] DELETE /identity/v3/users/c9a4f5ac438741bcad2867f46c4dfaeb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:32.931890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:32.941932 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1430-f17e-49c7-b38c-7765e48399a1 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.009515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.010440 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.010728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.011004 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] PATH_INFO: `/v3/projects/361c661f705d4a20aab09274092fc46d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.012223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361c661f705d4a20aab09274092fc46d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.014190 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.059857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361c661f705d4a20aab09274092fc46d', 'request_id': 'req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:33.066454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361c661f705d4a20aab09274092fc46d', 'request_id': 'req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:33.071672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361c661f705d4a20aab09274092fc46d', 'request_id': 'req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:33.082144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] The token cache is being invalidate because project 361c661f705d4a20aab09274092fc46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:33.082444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:33.083043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4f51d1fa-60a0-43f8-bc7f-e7d950c27327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:33.084611 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1370/2733] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:32 2022] DELETE /identity/v3/projects/361c661f705d4a20aab09274092fc46d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:33.089587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.089909 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.090192 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.108361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:33.109668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:33.168082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1364/2734] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:33.176274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.176562 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.176840 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.194457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:33.195663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:33.203476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1371/2735] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:33.207484 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.218117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc49a-3250-410e-9f5a-f3d9cd5659f2 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.222773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.223460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.223756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.224040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.225398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:33.225708 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.227352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.239275 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1365/2736] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:53:33.243306 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.252462 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a29072-9843-4a66-af4a-61fad7cba3f4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.257801 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.258558 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.258763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.259184 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.259776 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.261700 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.293064 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1372/2737] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:33 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:33.297448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.307365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68ce1-470f-4eef-8308-37d1c63923f1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.365227 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.365899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.366181 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.366455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.367205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.369133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.391659 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1366/2738] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:33 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:33.395833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.406357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f9671-4303-4a45-848d-ac25def2a94e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.411375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.412048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.412983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.413269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.413998 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.415626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.426243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1373/2739] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:33.430327 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.440856 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c1af5-dc55-46ec-9813-510b7453a746 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.445565 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac5b8-651b-4d92-98d0-10d522c03f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.446223 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac5b8-651b-4d92-98d0-10d522c03f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.446521 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac5b8-651b-4d92-98d0-10d522c03f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.446781 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac5b8-651b-4d92-98d0-10d522c03f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.447550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac5b8-651b-4d92-98d0-10d522c03f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.449164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac5b8-651b-4d92-98d0-10d522c03f52 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.460647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1367/2740] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:33.465016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.475513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb860-034d-4ee8-913d-3b62ecb75f10 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.480069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.480955 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.481238 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.481567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] PATH_INFO: `/v3/projects/6cbdf81fc05443069c0c6a427e02ace6/users/2c0fee49dc9b4145a3b08588e6e90b90/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.496993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbdf81fc05443069c0c6a427e02ace6, user_id=2c0fee49dc9b4145a3b08588e6e90b90, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.499715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.512616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1374/2741] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:33 2022] PUT /identity/v3/projects/6cbdf81fc05443069c0c6a427e02ace6/users/2c0fee49dc9b4145a3b08588e6e90b90/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:33.523914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.524205 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.524483 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.552272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] MFA Rules not processed for user `2c0fee49dc9b4145a3b08588e6e90b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:33.553466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:33.631369 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1368/2742] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:33.639587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.641187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:33.720237 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325349-2b9c-49c6-b863-f0179bee4ba1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.726507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.727221 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.727612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.727834 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.735923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.737521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:33.746977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1375/2743] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:33.922009 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:33.982566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb8b1c-e7ec-423f-b22e-c623703ba1a3 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:33.987248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:33.988122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:33.988405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:33.988679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] PATH_INFO: `/v3/users/2c0fee49dc9b4145a3b08588e6e90b90` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:33.989871 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0fee49dc9b4145a3b08588e6e90b90)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:33.991824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.040538 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0fee49dc9b4145a3b08588e6e90b90'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.053130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0fee49dc9b4145a3b08588e6e90b90'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.061506 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0fee49dc9b4145a3b08588e6e90b90'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.062121 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0fee49dc9b4145a3b08588e6e90b90'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.072609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c74d4f7e-b5eb-471c-9c91-ec562ae74f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0fee49dc9b4145a3b08588e6e90b90'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.073525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.074595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1369/2744] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:33 2022] DELETE /identity/v3/users/2c0fee49dc9b4145a3b08588e6e90b90 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:34.075483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.078634 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.078924 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.079232 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.089422 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5fdef-de69-4e17-a60d-d524169dfdca service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.095743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:34.096911 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.143845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.144749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.145275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.145559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] PATH_INFO: `/v3/users/ab06ba20ee4e47b7b957770c48bf5a6f` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.147316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab06ba20ee4e47b7b957770c48bf5a6f)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.149358 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.154063 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1370/2745] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:34.164670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.166142 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.195946 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab06ba20ee4e47b7b957770c48bf5a6f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.207090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab06ba20ee4e47b7b957770c48bf5a6f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.215825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab06ba20ee4e47b7b957770c48bf5a6f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.216513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab06ba20ee4e47b7b957770c48bf5a6f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.217119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-9c4c4848-97b0-44c5-8d4a-de0458c07c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab06ba20ee4e47b7b957770c48bf5a6f'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.222558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d060f7-c109-488e-954b-e24ce4c4f8d8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.226768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.227438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.227711 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.227988 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.229701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1376/2746] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:34 2022] DELETE /identity/v3/users/ab06ba20ee4e47b7b957770c48bf5a6f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:34.231167 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.235036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.235363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.235671 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.243930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.245365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.252342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:34.253529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.254604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1371/2747] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:34.317224 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1377/2748] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:34.324694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.326140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.338173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4b4b-d3f0-4e7d-84f6-2d88c1ae6237 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.388589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a93d-8a55-44e9-a22d-6acd3df3b9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.389240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a93d-8a55-44e9-a22d-6acd3df3b9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.389524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a93d-8a55-44e9-a22d-6acd3df3b9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.389800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a93d-8a55-44e9-a22d-6acd3df3b9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.404194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818a93d-8a55-44e9-a22d-6acd3df3b9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.405672 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818a93d-8a55-44e9-a22d-6acd3df3b9bf service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.415575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1372/2749] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:34.610547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.612232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.625174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212d00a-ceb6-41f1-b20a-403112c8a126 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.630250 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.631695 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.631984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.632415 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] PATH_INFO: `/v3/projects/6cbdf81fc05443069c0c6a427e02ace6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.633761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbdf81fc05443069c0c6a427e02ace6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.636457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.689552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbdf81fc05443069c0c6a427e02ace6', 'request_id': 'req-92392889-0625-47fb-aab6-33569bbe2abe'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.699021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbdf81fc05443069c0c6a427e02ace6', 'request_id': 'req-92392889-0625-47fb-aab6-33569bbe2abe'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.706494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbdf81fc05443069c0c6a427e02ace6', 'request_id': 'req-92392889-0625-47fb-aab6-33569bbe2abe'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.719617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] The token cache is being invalidate because project 6cbdf81fc05443069c0c6a427e02ace6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:34.720123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.721372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.724302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1378/2750] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:34 2022] DELETE /identity/v3/projects/6cbdf81fc05443069c0c6a427e02ace6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:34.730983 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df862-88f3-40ea-a47b-5b32c07cbda2 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.731669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df862-88f3-40ea-a47b-5b32c07cbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.732269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df862-88f3-40ea-a47b-5b32c07cbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.754196 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-cf9df862-88f3-40ea-a47b-5b32c07cbda2 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:34.755551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-cf9df862-88f3-40ea-a47b-5b32c07cbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.766600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.768032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.817927 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1373/2751] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:34.827825 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.827999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.828265 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.845059 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392889-0625-47fb-aab6-33569bbe2abe admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.846448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:34.847665 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.850339 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.851276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.851567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.851846 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] PATH_INFO: `/v3/projects/834355b661174ab790dc87d1a81cb6a2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.853125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=834355b661174ab790dc87d1a81cb6a2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.855043 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.857494 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1374/2752] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:34.861546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.871421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a100a-fd6d-4161-a93f-5dd479839e0c None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.876710 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.877378 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.877717 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.878062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.878895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:34.879286 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.881596 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:34.900931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1375/2753] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:53:34.904889 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834355b661174ab790dc87d1a81cb6a2', 'request_id': 'req-4fdf65d8-72b8-45a7-8d02-96f348172789'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.908431 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.921376 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834355b661174ab790dc87d1a81cb6a2', 'request_id': 'req-4fdf65d8-72b8-45a7-8d02-96f348172789'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.922802 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942841a-70d9-44de-a19a-9c3f8cad150a admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:34.934631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834355b661174ab790dc87d1a81cb6a2', 'request_id': 'req-4fdf65d8-72b8-45a7-8d02-96f348172789'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.947271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] The token cache is being invalidate because project 834355b661174ab790dc87d1a81cb6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:34.947600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.948346 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:34.950286 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1379/2754] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:34 2022] DELETE /identity/v3/projects/834355b661174ab790dc87d1a81cb6a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:34.954093 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:34.955587 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:34.987692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:34.988354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:34.988638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:34.988916 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:34.989595 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:34.992463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.017359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf65d8-72b8-45a7-8d02-96f348172789 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.017881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1376/2755] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:34 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:35.021908 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.023551 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.079209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.080037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.080354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.080637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] PATH_INFO: `/v3/users/ce6cfb71160b4f2cb49f5a2850d72b8e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.081878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6cfb71160b4f2cb49f5a2850d72b8e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.083882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.089814 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453e4a5-b313-45e2-be96-d245b7bf5e41 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.094390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.095048 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.095361 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.095636 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.096313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.098215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.120834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1377/2756] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:35.124937 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.129386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6cfb71160b4f2cb49f5a2850d72b8e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.134421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822530-d2ad-4c2f-93d6-d768b64e6eed admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.139015 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.139696 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.140018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.140284 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.141023 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.141261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6cfb71160b4f2cb49f5a2850d72b8e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.142625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.148125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6cfb71160b4f2cb49f5a2850d72b8e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.150108 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6cfb71160b4f2cb49f5a2850d72b8e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.150726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6cfb71160b4f2cb49f5a2850d72b8e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.153062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1378/2757] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:35.156810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.158486 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.165516 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1380/2758] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:34 2022] DELETE /identity/v3/users/ce6cfb71160b4f2cb49f5a2850d72b8e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:35.171244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb861f-9545-4998-b46c-e093b7042df7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.231772 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9e99e-e594-434d-be1c-739eb4629c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.232873 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9e99e-e594-434d-be1c-739eb4629c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.233307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9e99e-e594-434d-be1c-739eb4629c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.233770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9e99e-e594-434d-be1c-739eb4629c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.234498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9e99e-e594-434d-be1c-739eb4629c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.236249 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9e99e-e594-434d-be1c-739eb4629c12 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.246579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1379/2759] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:35.250683 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.260709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc575814-8646-49bf-9954-1c3828f9bf6b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.265910 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.266803 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.267088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.267395 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] PATH_INFO: `/v3/projects/bb70fff5f3204889978c6302f87f31db/users/ced0cf58b13a48138ecdceb3ae53b10b/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.282623 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb70fff5f3204889978c6302f87f31db, user_id=ced0cf58b13a48138ecdceb3ae53b10b, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.285316 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.299978 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1381/2760] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:35 2022] PUT /identity/v3/projects/bb70fff5f3204889978c6302f87f31db/users/ced0cf58b13a48138ecdceb3ae53b10b/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:35.312344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.312637 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.312955 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.338787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] MFA Rules not processed for user `ced0cf58b13a48138ecdceb3ae53b10b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:35.340036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.418403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1380/2761] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:35.423136 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.442602 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.444261 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.492039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3803bbc-61dc-47ac-b180-4a3d3dd2acfd admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.496874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.497532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.497815 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.498091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.498772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.500699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.517250 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a18ec-9369-4b0b-86ba-383da2777d4b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.523029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.523931 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.524220 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.524614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] PATH_INFO: `/v3/projects/ca5d7e4cefbd46b3b1c1e6962aeb5c6c` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.528715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5d7e4cefbd46b3b1c1e6962aeb5c6c)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.528874 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1382/2762] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:35.528981 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.529730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.573046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5d7e4cefbd46b3b1c1e6962aeb5c6c', 'request_id': 'req-d4e1cef3-c612-476c-a5ed-1535622d3449'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.580442 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5d7e4cefbd46b3b1c1e6962aeb5c6c', 'request_id': 'req-d4e1cef3-c612-476c-a5ed-1535622d3449'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.586459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5d7e4cefbd46b3b1c1e6962aeb5c6c', 'request_id': 'req-d4e1cef3-c612-476c-a5ed-1535622d3449'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.591005 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8af05-0a8e-4fce-b860-8201a13ffdb7 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.597335 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] The token cache is being invalidate because project ca5d7e4cefbd46b3b1c1e6962aeb5c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:35.597626 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.598276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d4e1cef3-c612-476c-a5ed-1535622d3449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:35.600467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1381/2763] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:35 2022] DELETE /identity/v3/projects/ca5d7e4cefbd46b3b1c1e6962aeb5c6c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:35.605164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8911a-b1fc-4082-9316-55544b7390d7 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.605644 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8911a-b1fc-4082-9316-55544b7390d7 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.605923 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8911a-b1fc-4082-9316-55544b7390d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.622987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-a0f8911a-b1fc-4082-9316-55544b7390d7 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:35.624201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-a0f8911a-b1fc-4082-9316-55544b7390d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.645879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.647078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.647389 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.647665 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.648352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.650258 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.673345 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1383/2764] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:35.674310 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.675950 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.683622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1382/2765] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:35.691726 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c5867-780d-4e88-85bd-2c3d8f0b5a49 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.692390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.692694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.692980 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.696507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.697172 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.697471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.697737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.698465 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.700089 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.710430 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1384/2766] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:35.711645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:35.712859 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:35.714411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.722076 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1383/2767] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:35.723852 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2432f-07ab-4d7f-804e-8e2583ce6fe8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.726513 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.729123 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.729985 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.730270 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.730551 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] PATH_INFO: `/v3/projects/05dd6fe3167248c9b4e399946273f5a4/users/8aae84ff4d7d498d8c97fb1c15c87901/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.735380 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01951f-5628-4ca7-b8f7-51fbaafbb26f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.740386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.741214 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.741544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.741828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.742598 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:35.742901 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.744539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.745132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dd6fe3167248c9b4e399946273f5a4, user_id=8aae84ff4d7d498d8c97fb1c15c87901, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.747807 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.756421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1384/2768] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:53:35.760559 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.760833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1385/2769] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:35 2022] PUT /identity/v3/projects/05dd6fe3167248c9b4e399946273f5a4/users/8aae84ff4d7d498d8c97fb1c15c87901/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:35.764525 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.769837 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629205-cc56-46ef-a5fc-229c632d2364 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.823653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.824300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.824579 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.824681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0247d-f323-439c-a16b-c30bee9c1779 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.824854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.825527 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.827448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.829312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.829977 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.830261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.830540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.831298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.832882 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.844503 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1386/2770] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:35.848896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.855961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1385/2771] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:35.856854 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.858582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c2d46-77bc-4b83-af5e-c6bd0d5f0a79 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.913483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774551b-a6de-41c6-ae7a-c8c7930df8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.914372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774551b-a6de-41c6-ae7a-c8c7930df8c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.914652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774551b-a6de-41c6-ae7a-c8c7930df8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.914952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774551b-a6de-41c6-ae7a-c8c7930df8c9 admin admin] PATH_INFO: `/v3/projects/05dd6fe3167248c9b4e399946273f5a4/users/8aae84ff4d7d498d8c97fb1c15c87901/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.915262 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b136f2c-4f1a-4857-b0f6-6d86089b3a6c admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.916922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774551b-a6de-41c6-ae7a-c8c7930df8c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dd6fe3167248c9b4e399946273f5a4, user_id=8aae84ff4d7d498d8c97fb1c15c87901, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.919610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774551b-a6de-41c6-ae7a-c8c7930df8c9 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.919796 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:35.920460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.920743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.921018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.921705 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:35.923679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:35.929775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1387/2772] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:35 2022] PUT /identity/v3/projects/05dd6fe3167248c9b4e399946273f5a4/users/8aae84ff4d7d498d8c97fb1c15c87901/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:35.941030 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039867-062d-4a98-8910-981795fc0118 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:35.941396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039867-062d-4a98-8910-981795fc0118 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:35.942044 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039867-062d-4a98-8910-981795fc0118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:35.946276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1386/2773] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:35.950136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:35.960316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776b60-1f0d-416a-9a95-ffb0f14078e9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:35.971467 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-40039867-062d-4a98-8910-981795fc0118 None None] MFA Rules not processed for user `8aae84ff4d7d498d8c97fb1c15c87901`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:35.972664 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-40039867-062d-4a98-8910-981795fc0118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.023940 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.024684 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.025033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.025388 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.026175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.027881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.038620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1387/2774] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:36.042363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.052312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1388/2775] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:36.057952 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685780e-a48a-4cd9-a40c-9f74ffa135f6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.063197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.063749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40039867-062d-4a98-8910-981795fc0118 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.063986 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.064282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.064572 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.065167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-40039867-062d-4a98-8910-981795fc0118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.065285 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.066896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.082537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1388/2776] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:36.083606 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.095196 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22143f-8fff-4de4-9c2e-244e5149a411 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.100256 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6171b92-7dac-4069-bed9-38af4fbf4ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.101224 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171b92-7dac-4069-bed9-38af4fbf4ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.101575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171b92-7dac-4069-bed9-38af4fbf4ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.101922 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171b92-7dac-4069-bed9-38af4fbf4ed9 admin admin] PATH_INFO: `/v3/projects/52ec54afd3734003bb889eec79a0737e/users/fffe6f738294429485f080a28f61a9de/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.117651 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6171b92-7dac-4069-bed9-38af4fbf4ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ec54afd3734003bb889eec79a0737e, user_id=fffe6f738294429485f080a28f61a9de, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.120669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6171b92-7dac-4069-bed9-38af4fbf4ed9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.124602 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40039867-062d-4a98-8910-981795fc0118 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.129273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.129929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.130213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.130487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.136700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1389/2777] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:36 2022] PUT /identity/v3/projects/52ec54afd3734003bb889eec79a0737e/users/fffe6f738294429485f080a28f61a9de/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:36.141232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.142736 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.147891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.148187 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.148481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.153936 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1389/2778] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:36.178270 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] MFA Rules not processed for user `fffe6f738294429485f080a28f61a9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:36.179880 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.260159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1390/2779] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:36.265743 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.277332 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb830f-899c-4820-84da-ba6c5a880928 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.322629 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.339833 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.340632 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.340922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.341197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.341890 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.344398 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.373515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1390/2780] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:36 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:36.376509 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.392146 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decc2cf-7e64-42e5-8660-dc1137e0d836 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.439522 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4ff7a-b796-4fb1-8adb-c6899bc03ab8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.446002 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.447037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.447702 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.448144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.449058 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.449269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.449934 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.450215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.450491 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] PATH_INFO: `/v3/users/ced0cf58b13a48138ecdceb3ae53b10b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.451296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.451698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced0cf58b13a48138ecdceb3ae53b10b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.453594 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.472578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1391/2781] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:36 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:36.476524 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.487269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93595-1dfe-43a5-a58d-f41c6f620d9c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.492655 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.493407 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.493615 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.493891 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.494628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.496307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.507061 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1392/2782] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:36.509609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced0cf58b13a48138ecdceb3ae53b10b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:36.510991 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.520486 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2486855-801b-4e04-9f05-069b5db82de5 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.521770 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced0cf58b13a48138ecdceb3ae53b10b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:36.525101 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.526037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.526322 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.526617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] PATH_INFO: `/v3/projects/4fc5aa2781e74de1be6b7b3412fd7c3d/users/d239696cdf5c4d79909dee6c6a3c0f58/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.530128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced0cf58b13a48138ecdceb3ae53b10b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:36.530829 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced0cf58b13a48138ecdceb3ae53b10b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:36.538283 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-38c2522c-2f83-43a5-a227-ce91a3e26504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced0cf58b13a48138ecdceb3ae53b10b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:36.543626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc5aa2781e74de1be6b7b3412fd7c3d, user_id=d239696cdf5c4d79909dee6c6a3c0f58, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.544448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1391/2783] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:36 2022] DELETE /identity/v3/users/ced0cf58b13a48138ecdceb3ae53b10b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:36.546420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.548848 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.549139 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.549421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.560528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1393/2784] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:36 2022] PUT /identity/v3/projects/4fc5aa2781e74de1be6b7b3412fd7c3d/users/d239696cdf5c4d79909dee6c6a3c0f58/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:36.564243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.565940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.570061 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:36.571257 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.627171 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1392/2785] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:36.629232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f24d-988b-4632-812c-30bb1824ffbd admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.634470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.635169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.635454 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.635729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.636457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.637144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.638072 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.638600 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.652050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1394/2786] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:36.653266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.662532 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60094e-e9aa-4559-a290-1eda48c75cff admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.667391 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e50c8-1011-4ace-be68-0048ea80674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.668259 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e50c8-1011-4ace-be68-0048ea80674f admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.668547 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e50c8-1011-4ace-be68-0048ea80674f admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.668835 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e50c8-1011-4ace-be68-0048ea80674f admin admin] PATH_INFO: `/v3/projects/4fc5aa2781e74de1be6b7b3412fd7c3d/users/d239696cdf5c4d79909dee6c6a3c0f58/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.670829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e50c8-1011-4ace-be68-0048ea80674f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc5aa2781e74de1be6b7b3412fd7c3d, user_id=d239696cdf5c4d79909dee6c6a3c0f58, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.673597 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e50c8-1011-4ace-be68-0048ea80674f admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.683567 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1395/2787] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:36 2022] PUT /identity/v3/projects/4fc5aa2781e74de1be6b7b3412fd7c3d/users/d239696cdf5c4d79909dee6c6a3c0f58/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:36.694160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.694354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009abe4e-b8dc-4e95-8e72-c929d47a6bad None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.694494 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.694775 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.727046 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] MFA Rules not processed for user `d239696cdf5c4d79909dee6c6a3c0f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:36.728295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.744194 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.744899 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.745128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.745402 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.794847 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1396/2788] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:36.803445 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.804947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.806115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.807520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:36.814462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1393/2789] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:36.864749 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d507-112a-4b10-ad9e-42f2d7f8e968 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.868457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.869103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.869386 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.869698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.879698 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:36.881656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:36.891277 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1397/2790] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:36.977832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:36.987091 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf8a7f-816d-4d6a-9f53-c1d283d47f69 service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:36.991467 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:36.992138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:36.992426 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:36.993123 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:36.994539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:37.065823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:37.067961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:37.079456 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1394/2791] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:37.325866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:37.327607 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:37.365885 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cc0ff-b27f-4a2e-985c-dd4cec4b9983 service cinder] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:37.383130 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:37.384480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:37.385707 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:37.386152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] PATH_INFO: `/v3/projects/bb70fff5f3204889978c6302f87f31db` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:37.387993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb70fff5f3204889978c6302f87f31db)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:37.391162 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:37.445816 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb70fff5f3204889978c6302f87f31db', 'request_id': 'req-e56a0488-ced4-42fb-80b6-d4428b7834ce'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.452633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb70fff5f3204889978c6302f87f31db', 'request_id': 'req-e56a0488-ced4-42fb-80b6-d4428b7834ce'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.458075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb70fff5f3204889978c6302f87f31db', 'request_id': 'req-e56a0488-ced4-42fb-80b6-d4428b7834ce'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.468937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] The token cache is being invalidate because project bb70fff5f3204889978c6302f87f31db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:37.469226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.469853 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.471464 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1398/2792] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:37 2022] DELETE /identity/v3/projects/bb70fff5f3204889978c6302f87f31db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:37.476034 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:37.486292 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccafd-4a2d-40c9-98f9-0864b9d98e34 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:37.541743 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:37.542614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:37.542900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:37.543215 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] PATH_INFO: `/v3/users/8aae84ff4d7d498d8c97fb1c15c87901` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:37.544403 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aae84ff4d7d498d8c97fb1c15c87901)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:37.546313 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:37.589040 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aae84ff4d7d498d8c97fb1c15c87901'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.600831 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aae84ff4d7d498d8c97fb1c15c87901'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.608090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aae84ff4d7d498d8c97fb1c15c87901'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.608887 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aae84ff4d7d498d8c97fb1c15c87901'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.616244 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-f477d3a3-3e43-4b45-8fb4-6eb10ad95f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aae84ff4d7d498d8c97fb1c15c87901'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:37.622078 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1395/2793] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:37 2022] DELETE /identity/v3/users/8aae84ff4d7d498d8c97fb1c15c87901 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:37.896765 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:37.898423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:37.913381 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a0488-ced4-42fb-80b6-d4428b7834ce admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:37.972299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:37.973187 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:37.973633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:37.973913 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] PATH_INFO: `/v3/projects/05dd6fe3167248c9b4e399946273f5a4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:37.975832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05dd6fe3167248c9b4e399946273f5a4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:37.977744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.031768 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dd6fe3167248c9b4e399946273f5a4', 'request_id': 'req-75905b59-822d-41c5-b6fe-8d96c499ea44'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:38.040505 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dd6fe3167248c9b4e399946273f5a4', 'request_id': 'req-75905b59-822d-41c5-b6fe-8d96c499ea44'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:38.047927 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dd6fe3167248c9b4e399946273f5a4', 'request_id': 'req-75905b59-822d-41c5-b6fe-8d96c499ea44'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:38.061084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] The token cache is being invalidate because project 05dd6fe3167248c9b4e399946273f5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:38.061372 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:38.062036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-75905b59-822d-41c5-b6fe-8d96c499ea44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:38.063920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1399/2794] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:37 2022] DELETE /identity/v3/projects/05dd6fe3167248c9b4e399946273f5a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:38.069164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.069688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.069688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.088354 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:38.089581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:38.148603 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1396/2795] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:38.156582 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.156905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.157225 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.175829 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:38.177048 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:38.185015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1400/2796] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:38.189131 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.199140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db1c1c-3ce3-4b10-a5dd-f4cfe2cad0d0 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.203692 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.204340 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.204623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.204900 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.205620 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:38.205926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.207632 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.219397 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1397/2797] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:53:38.223276 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.232434 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2662861-bffb-4c76-abe5-2d28fb2a7567 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.236986 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.237635 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.237923 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.238204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.238896 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.241096 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.265810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1401/2798] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:38.270025 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.283122 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbf1c-266e-4860-96ff-eac2038946b4 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.336556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.337438 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.337542 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.337760 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.338453 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.340480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.359389 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1398/2799] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:38.363649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.373864 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81ff4-d007-405c-9ad8-55fd1dfeeb12 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.378471 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.379153 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.379443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.379724 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.380453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.383140 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.393194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1402/2800] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:38.398103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.410164 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58422b-c5f2-4bb1-9748-1c89025f011d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.415297 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108454e5-be01-414f-bfba-dd8f7ccede72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.416556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108454e5-be01-414f-bfba-dd8f7ccede72 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.416556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108454e5-be01-414f-bfba-dd8f7ccede72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.416748 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108454e5-be01-414f-bfba-dd8f7ccede72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.417604 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108454e5-be01-414f-bfba-dd8f7ccede72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.419211 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108454e5-be01-414f-bfba-dd8f7ccede72 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.430300 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1399/2801] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:38.434374 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.454705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a57d55-fc11-4221-bbc3-5e0656fb7792 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.461412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.461412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.461412 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.461893 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] PATH_INFO: `/v3/projects/db964a7ccb8b4e4b8cb275e618228cb4/users/be1f0ce0d39b447f9e900f37cdf5dae5/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.478205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db964a7ccb8b4e4b8cb275e618228cb4, user_id=be1f0ce0d39b447f9e900f37cdf5dae5, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.481116 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.495317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1403/2802] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:38 2022] PUT /identity/v3/projects/db964a7ccb8b4e4b8cb275e618228cb4/users/be1f0ce0d39b447f9e900f37cdf5dae5/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:38.507405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.508401 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.508838 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.543178 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] MFA Rules not processed for user `be1f0ce0d39b447f9e900f37cdf5dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:38.544670 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:38.613798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1400/2803] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:38.618792 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.685673 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3d995-712f-45c6-99a7-aff468365202 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.690307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.690987 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.691284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.691568 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.692273 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.694232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.719540 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1404/2804] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:38.723863 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.735614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65873d27-799c-4741-b979-1d0dcdd12226 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.789338 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.790228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.790355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.790587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.791290 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.793201 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.813597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1401/2805] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:38 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:38.817589 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.828317 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e713-a2fe-4e2e-a5f6-d48151140848 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.833086 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.834447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.834844 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.835167 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.835924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.837552 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.848213 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1405/2806] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:38.852350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.862113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c470bc-33d4-4831-8aab-6eaf0506b8b9 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.866628 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.867529 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.867809 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.868080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] PATH_INFO: `/v3/projects/7af153b815494203ac6ce4c508d521fb/users/dca012a4cd054ee88c188efb41b97a4e/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.882779 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af153b815494203ac6ce4c508d521fb, user_id=dca012a4cd054ee88c188efb41b97a4e, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.885566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.898889 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1402/2807] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:38 2022] PUT /identity/v3/projects/7af153b815494203ac6ce4c508d521fb/users/dca012a4cd054ee88c188efb41b97a4e/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:38.902751 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.912514 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd504d75-bb36-4380-9fdd-6c92140e9961 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.966612 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0470df-5a95-4d71-b658-9b680c652e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.967314 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0470df-5a95-4d71-b658-9b680c652e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.967600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0470df-5a95-4d71-b658-9b680c652e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.967878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0470df-5a95-4d71-b658-9b680c652e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:38.968603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0470df-5a95-4d71-b658-9b680c652e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:38.970222 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0470df-5a95-4d71-b658-9b680c652e6e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:38.979453 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1406/2808] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:38.983505 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:38.993564 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472ac7-8fb4-42c9-a828-091c18e71cdd admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:38.998099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:38.998967 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:38.999288 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:38.999569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] PATH_INFO: `/v3/projects/7af153b815494203ac6ce4c508d521fb/users/dca012a4cd054ee88c188efb41b97a4e/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:39.001525 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af153b815494203ac6ce4c508d521fb, user_id=dca012a4cd054ee88c188efb41b97a4e, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:39.004240 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:39.014480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1403/2809] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:38 2022] PUT /identity/v3/projects/7af153b815494203ac6ce4c508d521fb/users/dca012a4cd054ee88c188efb41b97a4e/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:39.025058 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:39.025354 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:39.025633 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:39.051513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] MFA Rules not processed for user `dca012a4cd054ee88c188efb41b97a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:39.052772 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:39.118163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1407/2810] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:39 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:39.129610 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:39.131903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:39.186985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8971d-65b9-45bb-a633-56200eb915f1 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:39.190530 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:39.191248 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:39.191531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:39.191804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:39.201115 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:39.202532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:39.211589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1404/2811] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:39 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:39.280864 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:39.290330 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1e69-4cb6-48cf-a926-2d1d8a51e0a0 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:39.293949 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e41177-d01c-43ea-b15a-17b96ba009ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:39.294592 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41177-d01c-43ea-b15a-17b96ba009ec service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:39.294878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41177-d01c-43ea-b15a-17b96ba009ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:39.295188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41177-d01c-43ea-b15a-17b96ba009ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:39.349967 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e41177-d01c-43ea-b15a-17b96ba009ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:39.351444 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e41177-d01c-43ea-b15a-17b96ba009ec service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:39.360254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1408/2812] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:39 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:41.754548 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:41.756587 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:41.818836 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5169fa2-b98f-448b-a956-4c773794a8a4 service cinder] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:41.823478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:41.824365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:41.824625 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:41.824894 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] PATH_INFO: `/v3/users/fffe6f738294429485f080a28f61a9de` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:41.826236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffe6f738294429485f080a28f61a9de)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:41.828154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:41.875974 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffe6f738294429485f080a28f61a9de'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:41.888028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffe6f738294429485f080a28f61a9de'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:41.895544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffe6f738294429485f080a28f61a9de'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:41.896846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffe6f738294429485f080a28f61a9de'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:41.903697 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffe6f738294429485f080a28f61a9de'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:41.909682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1405/2813] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:41 2022] DELETE /identity/v3/users/fffe6f738294429485f080a28f61a9de => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:41.914291 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:41.914771 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:41.914883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:41.932272 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:41.933569 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:42.008738 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1409/2814] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:42.018704 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:42.020701 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:42.081881 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1e78a-30f4-4f82-b30f-77c7a31959f6 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:42.087149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:42.087149 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:42.087524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:42.087524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:42.096839 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:42.098266 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:42.107810 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1406/2815] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:42.389621 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:42.391472 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:42.406940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf001e-d7aa-489b-a161-2a74ac50774a None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:42.414296 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:42.415298 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:42.415554 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:42.416028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] PATH_INFO: `/v3/projects/52ec54afd3734003bb889eec79a0737e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:42.417368 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ec54afd3734003bb889eec79a0737e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:42.419435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:42.465686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ec54afd3734003bb889eec79a0737e', 'request_id': 'req-10e306b3-ad1d-421e-a801-19d5754a420e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.472979 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ec54afd3734003bb889eec79a0737e', 'request_id': 'req-10e306b3-ad1d-421e-a801-19d5754a420e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.478365 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ec54afd3734003bb889eec79a0737e', 'request_id': 'req-10e306b3-ad1d-421e-a801-19d5754a420e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.489034 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] The token cache is being invalidate because project 52ec54afd3734003bb889eec79a0737e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:42.489324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.490455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.492103 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1410/2816] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:42 2022] DELETE /identity/v3/projects/52ec54afd3734003bb889eec79a0737e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:42.495994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:42.505364 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2be4b-ca2d-47ac-96b3-ef6171b9e2bb service neutron] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:42.561175 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:42.562038 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:42.562317 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:42.562619 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] PATH_INFO: `/v3/users/d239696cdf5c4d79909dee6c6a3c0f58` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:42.563794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d239696cdf5c4d79909dee6c6a3c0f58)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:42.565688 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:42.608774 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd239696cdf5c4d79909dee6c6a3c0f58'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.620475 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd239696cdf5c4d79909dee6c6a3c0f58'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.627608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd239696cdf5c4d79909dee6c6a3c0f58'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.628322 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd239696cdf5c4d79909dee6c6a3c0f58'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.635421 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-a5c863a0-62d4-48d0-be1e-3682faea0088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd239696cdf5c4d79909dee6c6a3c0f58'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:42.641099 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1407/2817] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:42 2022] DELETE /identity/v3/users/d239696cdf5c4d79909dee6c6a3c0f58 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:42.903307 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:42.904706 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:42.918996 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e306b3-ad1d-421e-a801-19d5754a420e admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:42.974877 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:42.975778 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:42.976060 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:42.976336 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] PATH_INFO: `/v3/projects/4fc5aa2781e74de1be6b7b3412fd7c3d` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:42.977513 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc5aa2781e74de1be6b7b3412fd7c3d)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:42.979482 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.022676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc5aa2781e74de1be6b7b3412fd7c3d', 'request_id': 'req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:43.030439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc5aa2781e74de1be6b7b3412fd7c3d', 'request_id': 'req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:43.035791 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc5aa2781e74de1be6b7b3412fd7c3d', 'request_id': 'req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:43.046379 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] The token cache is being invalidate because project 4fc5aa2781e74de1be6b7b3412fd7c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:43.046942 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:43.047411 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-1642adb1-5eeb-424a-bf90-a5ecd535a3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:43.053904 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1411/2818] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:42 2022] DELETE /identity/v3/projects/4fc5aa2781e74de1be6b7b3412fd7c3d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:43.055451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.055926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.056130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.074791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:43.076093 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:43.133739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1408/2819] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:43.141559 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.141848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.142154 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.160274 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:43.161452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:43.169527 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1412/2820] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:43.173759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.183853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649030-b73b-4607-9879-d7535b0ff71f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.188459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.189116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.189405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.189683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.190409 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:43.190719 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.192350 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.207946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1409/2821] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 18:53:43.209205 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.218629 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c2bbf-364a-44d7-b956-bf06534465e4 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.223305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.223916 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.224157 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.224470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.225160 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.227029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.257245 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1413/2822] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:43 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:43.258328 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.267844 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643256-fab4-4272-a173-351a52b856d0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.327136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.327804 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.328089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.328404 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.329085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.330993 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.353928 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1410/2823] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:43 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:43.355188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.365656 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766f09-13b1-4043-a15e-3b6113b331ba admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.370204 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.370866 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.371174 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.371452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.372178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.373761 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.384442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1414/2824] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:43.388794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.399615 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaea3f-33fd-40aa-ad27-b9ebe7e60384 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.404767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cee0d-fe4c-43b0-994e-33adb456371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.405448 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cee0d-fe4c-43b0-994e-33adb456371d admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.405737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cee0d-fe4c-43b0-994e-33adb456371d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.406018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cee0d-fe4c-43b0-994e-33adb456371d admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.406744 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cee0d-fe4c-43b0-994e-33adb456371d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.408473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cee0d-fe4c-43b0-994e-33adb456371d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.421241 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1411/2825] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:43.425435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.435879 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990926-e130-4614-a0e4-a7df8149850a admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.440980 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.441747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.442209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.442666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] PATH_INFO: `/v3/projects/420e126c853c4bfab7e3ae46301027e6/users/9c294fd4bcc640f29cae7dc6aafa476b/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.458971 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420e126c853c4bfab7e3ae46301027e6, user_id=9c294fd4bcc640f29cae7dc6aafa476b, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.461777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.477014 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1415/2826] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:43 2022] PUT /identity/v3/projects/420e126c853c4bfab7e3ae46301027e6/users/9c294fd4bcc640f29cae7dc6aafa476b/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:43.487278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.487570 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.487853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.518555 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] MFA Rules not processed for user `9c294fd4bcc640f29cae7dc6aafa476b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:43.519100 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:43.586073 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1412/2827] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:43.596857 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:43.598614 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:43.659710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90eaca-fea0-4d47-8dd5-6b88485a7138 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:43.663397 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff013-ed48-4819-8988-97e22dc70f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:43.664037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff013-ed48-4819-8988-97e22dc70f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:43.664319 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff013-ed48-4819-8988-97e22dc70f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:43.664600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff013-ed48-4819-8988-97e22dc70f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:43.672658 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff013-ed48-4819-8988-97e22dc70f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:43.674078 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff013-ed48-4819-8988-97e22dc70f9c service cinder] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:43.683406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1416/2828] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:48.960638 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.019345 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e769-5c68-4610-8bb3-ee3b3804445a None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.024242 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.025177 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.025459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.025747 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] PATH_INFO: `/v3/users/9c294fd4bcc640f29cae7dc6aafa476b` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.026950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c294fd4bcc640f29cae7dc6aafa476b)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.029027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.076302 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c294fd4bcc640f29cae7dc6aafa476b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.087791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c294fd4bcc640f29cae7dc6aafa476b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.095128 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c294fd4bcc640f29cae7dc6aafa476b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.095739 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c294fd4bcc640f29cae7dc6aafa476b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.103315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c294fd4bcc640f29cae7dc6aafa476b'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.117729 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1413/2829] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:48 2022] DELETE /identity/v3/users/9c294fd4bcc640f29cae7dc6aafa476b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:49.117870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.117870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.117870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.132660 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:49.133842 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:49.191490 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1417/2830] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:49.202557 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.204020 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:49.260656 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584069e-794a-4d4e-85dc-1270bb4a151d admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.265135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed829b9c-b97c-437a-b3c5-fe6fc9575cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.265732 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed829b9c-b97c-437a-b3c5-fe6fc9575cad service neutron] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.266051 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed829b9c-b97c-437a-b3c5-fe6fc9575cad service neutron] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.266332 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed829b9c-b97c-437a-b3c5-fe6fc9575cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.276363 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed829b9c-b97c-437a-b3c5-fe6fc9575cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.277800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed829b9c-b97c-437a-b3c5-fe6fc9575cad service neutron] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.287148 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1414/2831] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:49.546755 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.548329 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:49.563067 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278f70e-31a9-40dc-b5a0-661937b8a097 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.568267 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.569457 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.569617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.569961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] PATH_INFO: `/v3/projects/420e126c853c4bfab7e3ae46301027e6` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.571098 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=420e126c853c4bfab7e3ae46301027e6)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.573069 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.618144 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420e126c853c4bfab7e3ae46301027e6', 'request_id': 'req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.624382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420e126c853c4bfab7e3ae46301027e6', 'request_id': 'req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.629711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420e126c853c4bfab7e3ae46301027e6', 'request_id': 'req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.640342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] The token cache is being invalidate because project 420e126c853c4bfab7e3ae46301027e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:49.640631 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.641293 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-53ac3bfd-8f96-4842-a85a-fde0cd5eb1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:49.642831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1418/2832] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:49 2022] DELETE /identity/v3/projects/420e126c853c4bfab7e3ae46301027e6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:49.650459 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.650749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.651028 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.668957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:49.670150 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:49.725140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1415/2833] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:49.734646 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.734940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.735254 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.753233 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:49.754449 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:49.762476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1419/2834] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:49.766391 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.776556 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4236c-5fe0-42cf-aa37-6c8a61b78175 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.781086 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.781728 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.782007 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.782280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.782996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:49.783406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.785033 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.796653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1416/2835] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:53:49.800549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.810050 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d666810-eb3c-4eb0-b559-7b51d330f5dd None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.815063 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.815870 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.816210 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.816425 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.817121 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.819031 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.845827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1420/2836] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:49.850476 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.862609 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45756-3973-4246-b2fe-dbe65ceacae3 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.919352 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.920022 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.920304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.920577 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.921267 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.923375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.943101 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1417/2837] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:49 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:49.947032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.957591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1b65-3104-44da-90b8-1b863f1a5fff admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.962747 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.963445 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.963727 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.964001 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.964730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.966305 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:49.977470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1421/2838] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:49.981655 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:49.991652 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48032680-150f-41a5-a0b1-6084ecd422b7 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:49.996272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02f564-00ba-4afe-bfb8-13e816bd954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:49.996932 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f564-00ba-4afe-bfb8-13e816bd954e admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:49.997330 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f564-00ba-4afe-bfb8-13e816bd954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:49.997547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f564-00ba-4afe-bfb8-13e816bd954e admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:49.998269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02f564-00ba-4afe-bfb8-13e816bd954e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:49.999994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02f564-00ba-4afe-bfb8-13e816bd954e admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:50.013396 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1418/2839] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:50.015275 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:50.027194 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b0dd-75f6-4a76-bbce-e2d565adadb1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:50.032302 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:50.033185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:50.033470 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:50.033753 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] PATH_INFO: `/v3/projects/405a3e51f56141a69e63455f947ea926/users/6fe214611cc848f6a297b3869baf39d2/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:50.048037 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405a3e51f56141a69e63455f947ea926, user_id=6fe214611cc848f6a297b3869baf39d2, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:50.050637 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:50.063563 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1422/2840] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:50 2022] PUT /identity/v3/projects/405a3e51f56141a69e63455f947ea926/users/6fe214611cc848f6a297b3869baf39d2/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:50.068643 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:50.068950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:50.069741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:50.087608 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:50.088826 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:50.145858 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1419/2841] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:50.155745 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:50.157485 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:50.217016 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5746e69-e755-4af5-ab0d-36de83921e29 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:50.222441 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:50.223129 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:50.223421 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:50.223704 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:50.233442 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:50.234940 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:50.247138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1423/2842] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:53.181522 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:53.183589 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:53.199016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268103e-3363-4697-8a24-acc1bc791d79 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:53.206406 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:53.208251 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:53.208707 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:53.209153 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] PATH_INFO: `/v3/users/0fbecbaf1c2c4caf8ccd3a3f5dd3c9be` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:53.212452 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbecbaf1c2c4caf8ccd3a3f5dd3c9be)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:53.221276 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:53.292217 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbecbaf1c2c4caf8ccd3a3f5dd3c9be'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:53.305961 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbecbaf1c2c4caf8ccd3a3f5dd3c9be'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:53.320422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbecbaf1c2c4caf8ccd3a3f5dd3c9be'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:53.321147 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbecbaf1c2c4caf8ccd3a3f5dd3c9be'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:53.330806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-84c5f424-e1fa-480d-85f2-0bbb24403455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbecbaf1c2c4caf8ccd3a3f5dd3c9be'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:53.341806 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1420/2843] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:53 2022] DELETE /identity/v3/users/0fbecbaf1c2c4caf8ccd3a3f5dd3c9be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:53.847905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:53.866423 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69463d-0f19-4916-87c5-c998717d051e service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:53.934499 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:53.935335 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:53.935686 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:53.936032 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] PATH_INFO: `/v3/projects/859382da1e70430ea905cb320e11c27c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:53.937337 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=859382da1e70430ea905cb320e11c27c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:53.939666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.002134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859382da1e70430ea905cb320e11c27c', 'request_id': 'req-713021b3-90bb-419f-95c0-4aa000f50e4b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.013681 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859382da1e70430ea905cb320e11c27c', 'request_id': 'req-713021b3-90bb-419f-95c0-4aa000f50e4b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.023439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859382da1e70430ea905cb320e11c27c', 'request_id': 'req-713021b3-90bb-419f-95c0-4aa000f50e4b'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.041247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] The token cache is being invalidate because project 859382da1e70430ea905cb320e11c27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:54.042362 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.043035 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.044922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1424/2844] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:53 2022] DELETE /identity/v3/projects/859382da1e70430ea905cb320e11c27c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:54.478017 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.478493 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.478768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.510132 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] MFA Rules not processed for user `6fe214611cc848f6a297b3869baf39d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:54.511489 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:54.570198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.571628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:54.584206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1421/2845] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:54.588985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.590700 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:54.642229 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713021b3-90bb-419f-95c0-4aa000f50e4b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:54.648603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:54.649830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.650266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.650798 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] PATH_INFO: `/v3/users/be1f0ce0d39b447f9e900f37cdf5dae5` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.652549 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1f0ce0d39b447f9e900f37cdf5dae5)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:54.655252 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.657695 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aff13-434b-4f6c-8f4f-c3b18eee2b40 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:54.662198 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:54.663457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.663751 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.664029 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.664715 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:54.666617 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.700508 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1422/2846] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:54.702407 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.706321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1f0ce0d39b447f9e900f37cdf5dae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.718906 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1f0ce0d39b447f9e900f37cdf5dae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.727340 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1f0ce0d39b447f9e900f37cdf5dae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.728097 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1f0ce0d39b447f9e900f37cdf5dae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.728748 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-41344d2d-f501-4cf2-a8c8-38572c695344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1f0ce0d39b447f9e900f37cdf5dae5'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:54.748937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1425/2847] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:54 2022] DELETE /identity/v3/users/be1f0ce0d39b447f9e900f37cdf5dae5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:54.751526 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.752861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.752861 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.777021 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:54.778311 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:54.782787 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2bb5c-13b9-42ed-a96d-eca679601df8 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:54.840827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:54.841544 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.841947 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.845247 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.845521 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1426/2848] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:54.846043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:54.846043 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.852367 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.853931 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:54.868624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1423/2849] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:54 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:54.872694 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.875136 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:54.886793 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e182f-f706-4727-b3e6-5f589b70fb36 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:54.891575 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:54.892253 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.892539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.892818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.893584 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:54.895457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.906478 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1424/2850] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:54.910415 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.919214 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276ec59-493d-4b14-83c8-592843fa73f8 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:54.920791 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdce3ef-d043-4d15-ad35-b6641148bdb2 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:54.923403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:54.924152 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.924475 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.924939 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.925641 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:54.926461 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:54.926756 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:54.927013 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] PATH_INFO: `/v3/projects/5c84406e8f6c4181a1f8b4372f8776ff/users/857caa12f88f4bd291cd023220bd84ff/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:54.936787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:54.939197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.952666 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1427/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 18:53:54.954176 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c84406e8f6c4181a1f8b4372f8776ff, user_id=857caa12f88f4bd291cd023220bd84ff, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:54.956958 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:54.980571 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1425/2852] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:54 2022] PUT /identity/v3/projects/5c84406e8f6c4181a1f8b4372f8776ff/users/857caa12f88f4bd291cd023220bd84ff/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:54.982271 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:54.992511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd4e06-30a8-426a-9ddf-23879b292d0a service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:55.063403 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:55.064662 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:55.064883 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:55.065188 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:55.066124 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:55.067880 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:55.078320 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1428/2853] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:55.082566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:55.094252 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4170b9-acc0-4e40-a4c7-2d882b2da8b0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:55.101897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:55.101897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:55.101897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:55.101897 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] PATH_INFO: `/v3/projects/5c84406e8f6c4181a1f8b4372f8776ff/users/857caa12f88f4bd291cd023220bd84ff/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:55.107008 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c84406e8f6c4181a1f8b4372f8776ff, user_id=857caa12f88f4bd291cd023220bd84ff, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:55.111926 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:55.123612 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1426/2854] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:55 2022] PUT /identity/v3/projects/5c84406e8f6c4181a1f8b4372f8776ff/users/857caa12f88f4bd291cd023220bd84ff/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:55.330455 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:55.332676 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:55.377011 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d2f4a-22c4-4e8b-9e2d-2b1676921377 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:55.452959 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:55.454054 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:55.455661 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:55.455961 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] PATH_INFO: `/v3/projects/db964a7ccb8b4e4b8cb275e618228cb4` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:55.457341 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db964a7ccb8b4e4b8cb275e618228cb4)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:55.459414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:55.552247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db964a7ccb8b4e4b8cb275e618228cb4', 'request_id': 'req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.563410 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db964a7ccb8b4e4b8cb275e618228cb4', 'request_id': 'req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.571788 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db964a7ccb8b4e4b8cb275e618228cb4', 'request_id': 'req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.586810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] The token cache is being invalidate because project db964a7ccb8b4e4b8cb275e618228cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:55.587729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.588489 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.590825 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1429/2855] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:55 2022] DELETE /identity/v3/projects/db964a7ccb8b4e4b8cb275e618228cb4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:55.594895 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:55.596905 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:55.613771 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f71959-3a7b-418a-a92b-b24df0b87188 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:55.686368 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:55.687316 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:55.687828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:55.688112 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] PATH_INFO: `/v3/users/dca012a4cd054ee88c188efb41b97a4e` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:55.689394 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca012a4cd054ee88c188efb41b97a4e)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:55.691386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:55.746272 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca012a4cd054ee88c188efb41b97a4e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.761746 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca012a4cd054ee88c188efb41b97a4e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.775156 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca012a4cd054ee88c188efb41b97a4e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.776222 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca012a4cd054ee88c188efb41b97a4e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.786392 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-4c441d25-b69e-4960-979e-c05c41d578a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca012a4cd054ee88c188efb41b97a4e'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:55.796355 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1427/2856] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:55 2022] DELETE /identity/v3/users/dca012a4cd054ee88c188efb41b97a4e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:56.161697 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.181406 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7985a-805e-4c6d-ae6f-ffb8c20217a1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.245138 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.246020 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.246301 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.246575 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] PATH_INFO: `/v3/projects/7af153b815494203ac6ce4c508d521fb` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.247805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af153b815494203ac6ce4c508d521fb)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.249710 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.318269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af153b815494203ac6ce4c508d521fb', 'request_id': 'req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:56.330438 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af153b815494203ac6ce4c508d521fb', 'request_id': 'req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:56.344518 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af153b815494203ac6ce4c508d521fb', 'request_id': 'req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:56.363766 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] The token cache is being invalidate because project 7af153b815494203ac6ce4c508d521fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:56.364062 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:56.364764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-abfe1a8f-d983-4ab6-8b4e-6d7953c18898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:56.367284 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1430/2857] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:56 2022] DELETE /identity/v3/projects/7af153b815494203ac6ce4c508d521fb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:56.379481 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.379737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.379904 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.401517 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:56.403003 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:56.511492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1428/2858] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:56.513285 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.513576 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.513855 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.537013 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:56.538969 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:56.550741 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1431/2859] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:56.551987 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.563601 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213d675-c2af-44ad-bfd6-45554565c837 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.569365 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.570144 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.570524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.570957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.571824 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:53:56.572645 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.574138 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.599405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1429/2860] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:53:56.601261 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.610519 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58733f76-3d16-42f4-b1f3-e06964740151 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.617312 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.618262 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.619451 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.619742 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.620476 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.622921 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.656679 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.659197 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1432/2861] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:56 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:56.667206 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b984ca1-2a0a-428a-b46c-9f909133cccc admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.730827 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.731862 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.732209 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.732738 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.733539 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.739702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.772070 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1430/2862] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:56 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:56.776288 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.802308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f211ded-1cd4-4f7a-86f8-469c25ec413b admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.808699 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.809520 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.809811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.810091 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.810827 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.813024 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.831984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1433/2863] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:56.833627 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.845417 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa097e-563d-4804-bed1-1cd5f0cb74ee admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.854314 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09da33-df38-4148-903c-81ed17d19991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.855446 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09da33-df38-4148-903c-81ed17d19991 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.856563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09da33-df38-4148-903c-81ed17d19991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.857054 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09da33-df38-4148-903c-81ed17d19991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.858524 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09da33-df38-4148-903c-81ed17d19991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.860422 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09da33-df38-4148-903c-81ed17d19991 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.879173 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1431/2864] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:56.884075 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:56.901163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bc97d-d4b0-4bff-bf92-08fee8a779b6 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:56.906730 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:56.907763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.912550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.912550 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] PATH_INFO: `/v3/projects/cf34cbe8cb98462aa205291481cb805c/users/ed53458e3139431493732795cb76b560/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:56.933282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf34cbe8cb98462aa205291481cb805c, user_id=ed53458e3139431493732795cb76b560, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:56.936231 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:56.958243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1434/2865] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:56 2022] PUT /identity/v3/projects/cf34cbe8cb98462aa205291481cb805c/users/ed53458e3139431493732795cb76b560/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:56.970492 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:56.970939 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:56.971419 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.026683 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] MFA Rules not processed for user `ed53458e3139431493732795cb76b560`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:57.028057 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:57.109133 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1432/2866] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:57.113786 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.190937 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811016e9-9d45-4775-90eb-b04461440c59 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.203729 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.204717 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.205324 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.205794 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.206667 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.209207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.244084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1435/2867] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:53:57 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 18:53:57.248134 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.267532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9ca2-b50e-400b-bab2-af07ad95562f None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.365236 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.366560 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.366912 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.367310 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.368289 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.370504 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.397090 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1433/2868] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:53:57 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:53:57.401781 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.413427 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8f240-9ad7-4115-bde9-ea7a741459d3 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.418984 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.419924 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.420382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.420832 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.421746 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.423701 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.437600 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1436/2869] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:53:57.441682 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.453384 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d39d-224a-464b-96cc-f4c96f1d3be0 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.458754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.460496 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.460902 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.461282 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] PATH_INFO: `/v3/projects/d6c770f789e0440ca2f4d6797b16d335/users/a5f1a2fa926e4d63aa8ec278dab1c65c/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.479373 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c770f789e0440ca2f4d6797b16d335, user_id=a5f1a2fa926e4d63aa8ec278dab1c65c, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.482433 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.497096 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1434/2870] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:57 2022] PUT /identity/v3/projects/d6c770f789e0440ca2f4d6797b16d335/users/a5f1a2fa926e4d63aa8ec278dab1c65c/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 18:53:57.501041 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.512300 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6ffb4-cb40-4d36-ad3c-d2fcaabf0d3c admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.576647 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64192f-d346-4193-8fc0-fd3cad61ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.577344 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64192f-d346-4193-8fc0-fd3cad61ae94 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.577641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64192f-d346-4193-8fc0-fd3cad61ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.577922 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64192f-d346-4193-8fc0-fd3cad61ae94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.578663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64192f-d346-4193-8fc0-fd3cad61ae94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.580357 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64192f-d346-4193-8fc0-fd3cad61ae94 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.599299 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1437/2871] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 18:53:57.601851 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.617693 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d8d28-dff1-4e85-9991-0c6021187dda admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.622580 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.624801 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.625092 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.625371 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] PATH_INFO: `/v3/projects/d6c770f789e0440ca2f4d6797b16d335/users/a5f1a2fa926e4d63aa8ec278dab1c65c/roles/77248c1ae58244c1b1b570bc66fa8103` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.627841 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c770f789e0440ca2f4d6797b16d335, user_id=a5f1a2fa926e4d63aa8ec278dab1c65c, role_id=77248c1ae58244c1b1b570bc66fa8103)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.630769 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.642817 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1435/2872] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:53:57 2022] PUT /identity/v3/projects/d6c770f789e0440ca2f4d6797b16d335/users/a5f1a2fa926e4d63aa8ec278dab1c65c/roles/77248c1ae58244c1b1b570bc66fa8103 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:57.654613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.654613 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.655090 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.690837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] MFA Rules not processed for user `a5f1a2fa926e4d63aa8ec278dab1c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:57.697628 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:57.843092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1438/2873] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:53:57.854460 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:57.856501 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:57.926451 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856d12b-af70-481f-87dd-6bcfd1d4025f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:57.930985 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649b8e7-7a63-49e8-a2c2-d73354387a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:57.932278 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649b8e7-7a63-49e8-a2c2-d73354387a45 service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:57.932807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649b8e7-7a63-49e8-a2c2-d73354387a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:57.933315 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649b8e7-7a63-49e8-a2c2-d73354387a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:57.945390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649b8e7-7a63-49e8-a2c2-d73354387a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:57.947430 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649b8e7-7a63-49e8-a2c2-d73354387a45 service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:57.966712 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1436/2874] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:58.814183 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:58.949731 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3b344-6e55-4ad0-ad77-78e856b59ed3 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:58.958947 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:58.961039 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:58.961529 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:58.962015 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] PATH_INFO: `/v3/users/ed53458e3139431493732795cb76b560` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:58.963578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed53458e3139431493732795cb76b560)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:58.966744 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:59.033918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed53458e3139431493732795cb76b560'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.056018 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed53458e3139431493732795cb76b560'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.067507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed53458e3139431493732795cb76b560'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.068897 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed53458e3139431493732795cb76b560'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.069560 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed53458e3139431493732795cb76b560'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.094675 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1439/2875] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:58 2022] DELETE /identity/v3/users/ed53458e3139431493732795cb76b560 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:59.099255 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:59.099768 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:59.100016 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:59.135537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:53:59.137110 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:59.266273 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1437/2876] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:53:59.281084 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:59.283483 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:59.365596 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d2e1-8a36-41d0-b766-16ebaa3857a8 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:59.375168 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:59.375934 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:59.376226 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:59.376604 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:59.399207 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:59.400787 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:59.421545 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1440/2877] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:53:59.820994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:59.823062 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:53:59.850362 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1f738-1a51-4c6b-b73f-bf60d2ede98b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:53:59.856140 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:53:59.857238 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:53:59.857377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:53:59.857558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] PATH_INFO: `/v3/projects/cf34cbe8cb98462aa205291481cb805c` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:53:59.858798 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf34cbe8cb98462aa205291481cb805c)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:53:59.860977 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:53:59.920537 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf34cbe8cb98462aa205291481cb805c', 'request_id': 'req-bf500fb4-6bd4-4ce7-9620-33ca8982e522'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.928532 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf34cbe8cb98462aa205291481cb805c', 'request_id': 'req-bf500fb4-6bd4-4ce7-9620-33ca8982e522'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.936797 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf34cbe8cb98462aa205291481cb805c', 'request_id': 'req-bf500fb4-6bd4-4ce7-9620-33ca8982e522'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.958566 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] The token cache is being invalidate because project cf34cbe8cb98462aa205291481cb805c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:53:59.958867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.962462 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-bf500fb4-6bd4-4ce7-9620-33ca8982e522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:53:59.964390 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1438/2878] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:53:59 2022] DELETE /identity/v3/projects/cf34cbe8cb98462aa205291481cb805c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:53:59.968175 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:53:59.980777 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b41032-a960-4ad4-b6f3-8b594ed061a8 service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:00.077715 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:00.079212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.079709 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.080209 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] PATH_INFO: `/v3/users/a5f1a2fa926e4d63aa8ec278dab1c65c` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.082147 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f1a2fa926e4d63aa8ec278dab1c65c)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:00.086134 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:00.166976 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f1a2fa926e4d63aa8ec278dab1c65c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.198243 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f1a2fa926e4d63aa8ec278dab1c65c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.210721 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f1a2fa926e4d63aa8ec278dab1c65c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.211511 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f1a2fa926e4d63aa8ec278dab1c65c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.213323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f1a2fa926e4d63aa8ec278dab1c65c'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.233688 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1441/2879] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:53:59 2022] DELETE /identity/v3/users/a5f1a2fa926e4d63aa8ec278dab1c65c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:54:00.274623 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.275103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.275103 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.307994 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] MFA Rules not processed for user `857caa12f88f4bd291cd023220bd84ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:00.309597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.386526 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1439/2880] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:00.405536 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:00.408242 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.499720 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6067f20-f29f-429c-af6d-c9ab980b61f0 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:00.505077 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cef8f88990984c38945657983e4111f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:00.505905 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.507954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.508350 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.510396 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.602418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:00.604057 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1572-8c50-4d30-8641-2e9392d948a1 service glance] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:00.615817 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1442/2881] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:54:00.627498 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:00.628968 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.710963 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbd3de-0d1d-4b68-9526-997ab6ef9d71 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:00.717358 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:00.718512 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.718996 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.720890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] PATH_INFO: `/v3/projects/d6c770f789e0440ca2f4d6797b16d335` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.722554 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c770f789e0440ca2f4d6797b16d335)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:00.724562 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:00.769125 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.771663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.771663 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.809435 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:00.810645 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.822116 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c770f789e0440ca2f4d6797b16d335', 'request_id': 'req-d11857d6-58a8-42a0-94e4-f6388cc34116'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.834221 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c770f789e0440ca2f4d6797b16d335', 'request_id': 'req-d11857d6-58a8-42a0-94e4-f6388cc34116'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.842624 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c770f789e0440ca2f4d6797b16d335', 'request_id': 'req-d11857d6-58a8-42a0-94e4-f6388cc34116'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.856800 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] The token cache is being invalidate because project d6c770f789e0440ca2f4d6797b16d335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:54:00.857343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.859037 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-d11857d6-58a8-42a0-94e4-f6388cc34116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:00.861819 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1440/2882] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:54:00 2022] DELETE /identity/v3/projects/d6c770f789e0440ca2f4d6797b16d335 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:54:00.869528 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41455a4-dbe4-4081-b5ca-c4c04de4378a None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.869828 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41455a4-dbe4-4081-b5ca-c4c04de4378a None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.870113 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41455a4-dbe4-4081-b5ca-c4c04de4378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.890408 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-c41455a4-dbe4-4081-b5ca-c4c04de4378a None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:00.891669 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-c41455a4-dbe4-4081-b5ca-c4c04de4378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.892115 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1443/2883] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 18:54:00.953443 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:00.954831 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:00.975466 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1441/2884] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:00.977377 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:00.977767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:00.978137 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:00.997089 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:00.998400 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:01.010853 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1442/2885] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:01.012172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.021773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08396f2b-d91b-4e0c-8926-28b98b0a4dc8 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.027031 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.027742 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.028027 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.028304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.029041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 18:54:01.029376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.031000 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.036169 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e388aac-5320-4393-98c6-4a1ac4181149 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.042452 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.043304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1443/2886] 10.222.0.45 () {58 vars in 1152 bytes} [Fri Apr 29 18:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 18:54:01.043447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.047027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.047416 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.047957 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.059126 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.060752 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.061767 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4202bb1-a0cb-42f9-83e5-f77f6b9aef41 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.067102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.068035 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.068376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.068585 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.069846 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.071794 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.072255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1444/2887] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:54:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 29 18:54:01.115323 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1444/2888] 10.222.0.45 () {60 vars in 1152 bytes} [Fri Apr 29 18:54:01 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:54:01.118626 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.132693 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da38651-21dc-43a4-bf8e-c0c43874ac0c service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.201790 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.202617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.202856 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.203165 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] PATH_INFO: `/v3/users` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.203876 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.206006 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.232557 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1445/2889] 10.222.0.45 () {60 vars in 1143 bytes} [Fri Apr 29 18:54:01 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 18:54:01.236930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.249182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0ec7-8634-476b-a674-7d4e18b42442 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.255664 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.256343 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.256832 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.257114 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.259154 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.261190 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.277903 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1445/2890] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:54:01.282480 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.293649 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d0ac3-00ba-465f-8152-7eca6c526e8d admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.299929 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ec765-4bdf-4a2a-9637-5a39cc13cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.300805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ec765-4bdf-4a2a-9637-5a39cc13cd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.301178 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ec765-4bdf-4a2a-9637-5a39cc13cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.301617 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ec765-4bdf-4a2a-9637-5a39cc13cd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.302463 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ec765-4bdf-4a2a-9637-5a39cc13cd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.304928 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ec765-4bdf-4a2a-9637-5a39cc13cd82 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.319156 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1446/2891] 10.222.0.45 () {58 vars in 1121 bytes} [Fri Apr 29 18:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 18:54:01.322550 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.334212 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c72f54-b6f2-4e8c-8b14-9cc7f4a98a76 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.339077 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.340130 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.340479 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.340823 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] PATH_INFO: `/v3/projects/2bbe72d296d24da5ae613c17c9d1c92a/users/58578e452b1840d5867ae5ea5beac86e/roles/0770ca7325a8434d91507daed896ceb2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.356917 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbe72d296d24da5ae613c17c9d1c92a, user_id=58578e452b1840d5867ae5ea5beac86e, role_id=0770ca7325a8434d91507daed896ceb2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.359783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.378543 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1446/2892] 10.222.0.45 () {60 vars in 1482 bytes} [Fri Apr 29 18:54:01 2022] PUT /identity/v3/projects/2bbe72d296d24da5ae613c17c9d1c92a/users/58578e452b1840d5867ae5ea5beac86e/roles/0770ca7325a8434d91507daed896ceb2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:54:01.393487 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.393810 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.394051 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.429375 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] MFA Rules not processed for user `58578e452b1840d5867ae5ea5beac86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:01.430515 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:01.562269 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1447/2893] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:01.578172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.581197 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:01.709184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64babd2-0dca-4a6b-b7f8-6a70ef432939 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.713386 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8edc1-ceaa-434e-9c6c-17b39de0eb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0de2845217b943189e11f8a6549b1524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.714041 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8edc1-ceaa-434e-9c6c-17b39de0eb1a service cinder] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.714326 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8edc1-ceaa-434e-9c6c-17b39de0eb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.714597 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8edc1-ceaa-434e-9c6c-17b39de0eb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.739046 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8edc1-ceaa-434e-9c6c-17b39de0eb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.740737 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8edc1-ceaa-434e-9c6c-17b39de0eb1a service cinder] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.755172 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1447/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:54:01.776653 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:01.860737 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40460-451a-4014-97db-5061dbb8d779 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:01.866223 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:01.869997 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.870603 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.871133 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] PATH_INFO: `/v3/users/58578e452b1840d5867ae5ea5beac86e` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:01.872705 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58578e452b1840d5867ae5ea5beac86e)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:01.875414 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:01.937228 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58578e452b1840d5867ae5ea5beac86e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:01.949652 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58578e452b1840d5867ae5ea5beac86e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:01.961983 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58578e452b1840d5867ae5ea5beac86e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:01.964672 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58578e452b1840d5867ae5ea5beac86e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:01.965308 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58578e452b1840d5867ae5ea5beac86e'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:01.979837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1448/2895] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:54:01 2022] DELETE /identity/v3/users/58578e452b1840d5867ae5ea5beac86e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:54:01.985082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:01.985622 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:01.985914 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:02.004724 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] MFA Rules not processed for user `98401350f90343bfb675fc3a572f111b`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:02.006066 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:02.087999 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1448/2896] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:02.094590 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:02.096282 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:02.180321 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22107-d2ae-452a-b7d8-1267090f1db1 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:02.186809 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41785779-6052-49c0-80cd-e69120cc621a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:02.189811 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785779-6052-49c0-80cd-e69120cc621a service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:02.190027 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785779-6052-49c0-80cd-e69120cc621a service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:02.190439 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785779-6052-49c0-80cd-e69120cc621a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:02.206418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41785779-6052-49c0-80cd-e69120cc621a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:02.207198 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41785779-6052-49c0-80cd-e69120cc621a service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:02.219029 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1449/2897] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:54:02.643898 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:02.645698 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:02.661960 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5abe-7854-4b5b-972e-01e6f9347347 None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:02.670182 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:02.671567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:02.672082 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:02.673039 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] PATH_INFO: `/v3/projects/2bbe72d296d24da5ae613c17c9d1c92a` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:02.674563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbe72d296d24da5ae613c17c9d1c92a)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:02.677473 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:02.738398 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbe72d296d24da5ae613c17c9d1c92a', 'request_id': 'req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:02.748563 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbe72d296d24da5ae613c17c9d1c92a', 'request_id': 'req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:02.759036 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbe72d296d24da5ae613c17c9d1c92a', 'request_id': 'req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:02.774930 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] The token cache is being invalidate because project 2bbe72d296d24da5ae613c17c9d1c92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:54:02.775588 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:02.776405 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:54:02.778509 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1449/2898] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:54:02 2022] DELETE /identity/v3/projects/2bbe72d296d24da5ae613c17c9d1c92a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:54:10.320668 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5680-1694-4f94-a852-e8ea2c31f497 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:10.321150 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5680-1694-4f94-a852-e8ea2c31f497 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:10.321247 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5680-1694-4f94-a852-e8ea2c31f497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:10.338119 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-dc5b5680-1694-4f94-a852-e8ea2c31f497 None None] MFA Rules not processed for user `6fe214611cc848f6a297b3869baf39d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:10.339352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-dc5b5680-1694-4f94-a852-e8ea2c31f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:10.391586 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1450/2899] 10.222.0.45 () {58 vars in 957 bytes} [Fri Apr 29 18:54:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:11.942450 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:11.944344 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:12.010614 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c64f7-8a4a-4a0a-a4a4-25f0c14d2e24 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:12.015569 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:12.016218 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:12.016503 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:12.016783 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:12.018546 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:12.031085 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:12.032702 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:12.042852 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1450/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:54:16.266212 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] REQUEST_METHOD: `POST` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:16.266670 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:16.266764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:16.284404 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.auth.core [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:54:16.285610 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:16.340878 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1451/2901] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Apr 29 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:54:16.354946 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:16.356890 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:16.434653 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00833d-a2b2-47df-b556-112f651848e3 service placement] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:16.439875 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:16.440660 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:16.440949 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:16.441233 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:16.453412 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:16.455014 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:16.464307 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1451/2902] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:54:27.048266 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:27.049760 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:27.103578 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384966-1666-4da6-a0ce-5b9f7d8c6d16 None None] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:27.107049 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:27.107714 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:27.108122 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:27.108334 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:27.110036 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:27.119735 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:27.121145 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:27.128954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1452/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:54:34.472647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:34.474102 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:34.547891 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab1e58-5bb4-4125-a4be-330acadda4d5 service swift] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:34.553324 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:34.553978 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:34.554269 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:34.555080 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:34.556896 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:34.569079 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:34.571174 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:34.581531 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1452/2904] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:54:41.067813 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:54:41.069232 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:41.127591 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fdf8b-ee5e-45a1-ad9b-8ee49481231d service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:54:41.131164 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840dcc6108454d54ac3fde8bd2096665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:54:41.131805 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:54:41.132088 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:54:41.132363 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:54:41.134083 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:54:41.211989 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:54:41.213418 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:54:41.222711 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1453/2905] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:54:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:55:45.878754 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:55:45.880184 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:55:45.968376 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af62cde-37bf-4c43-bb03-7759963e33e1 service nova] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:55:45.973455 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:55:45.974095 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:55:45.974379 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:55:45.974654 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:55:45.976437 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:55:45.987759 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:55:45.989159 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21a41-07ee-44c4-9cfb-be6b456c80f4 service placement] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:55:45.999053 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1453/2906] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:55:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:57:03.096952 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:57:03.137373 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e63a21-5092-4de8-8802-edb2eafd837d service neutron] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:57:03.144146 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c539d6a3d1d49bcaadcea8970560c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:57:03.144894 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:03.145185 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:03.145763 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:03.148092 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:57:03.182420 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:57:03.184076 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:57:03.207644 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1454/2907] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 18:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 18:57:10.314950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] REQUEST_METHOD: `POST` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:10.315463 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:10.315567 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:10.371375 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.auth.core [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] MFA Rules not processed for user `e399c8a0fd11423c8a70db4235228060`. Rule list: `[]` (Enabled: `True`). {{(pid=80124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 18:57:10.372581 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:57:10.390749 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1454/2908] 10.222.0.45 () {58 vars in 967 bytes} [Fri Apr 29 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 18:57:10.430281 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:57:10.452010 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894aa9-a76f-4b50-a393-1655992d8a85 service nova] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:57:10.457380 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e60e2dfa5814b699d107aa74f55c59f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:57:10.458071 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] REQUEST_METHOD: `GET` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:10.458359 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:10.458641 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:10.467283 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:57:10.468920 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:57:10.476823 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1455/2909] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Apr 29 18:57:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 18:57:16.859720 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:57:16.861165 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:57:16.969785 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49811aa5-42d2-48a2-bb58-6a43c7329a5b None None] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:57:16.974321 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:57:16.975213 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:16.975497 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:16.975773 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] PATH_INFO: `/v3/users/6fe214611cc848f6a297b3869baf39d2` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:16.976969 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe214611cc848f6a297b3869baf39d2)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:57:16.978925 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:57:17.024030 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe214611cc848f6a297b3869baf39d2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.035069 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe214611cc848f6a297b3869baf39d2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.041864 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe214611cc848f6a297b3869baf39d2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.042480 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe214611cc848f6a297b3869baf39d2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.049004 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe214611cc848f6a297b3869baf39d2'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.054668 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1455/2910] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:57:16 2022] DELETE /identity/v3/users/6fe214611cc848f6a297b3869baf39d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:57:17.226360 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:57:17.237255 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdd8e4-62a6-4887-994c-fad0e3668f37 service swift] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:57:17.293163 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:57:17.294028 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:17.294342 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:17.294616 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] PATH_INFO: `/v3/projects/405a3e51f56141a69e63455f947ea926` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:17.295802 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405a3e51f56141a69e63455f947ea926)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:57:17.297692 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:57:17.340837 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405a3e51f56141a69e63455f947ea926', 'request_id': 'req-59becf8f-cba4-4e85-a117-312b50a3dc37'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.347845 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405a3e51f56141a69e63455f947ea926', 'request_id': 'req-59becf8f-cba4-4e85-a117-312b50a3dc37'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.353694 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405a3e51f56141a69e63455f947ea926', 'request_id': 'req-59becf8f-cba4-4e85-a117-312b50a3dc37'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.364447 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] The token cache is being invalidate because project 405a3e51f56141a69e63455f947ea926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:57:17.364728 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.365352 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.366848 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1456/2911] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:57:17 2022] DELETE /identity/v3/projects/405a3e51f56141a69e63455f947ea926 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:57:17.371547 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:57:17.372956 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:57:17.385834 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11770b-3b98-49b8-ac48-ab41fa9e613f admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:57:17.439689 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:57:17.440561 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:17.440843 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:17.441117 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] PATH_INFO: `/v3/users/857caa12f88f4bd291cd023220bd84ff` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:17.442304 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857caa12f88f4bd291cd023220bd84ff)` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:57:17.444280 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:57:17.488231 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857caa12f88f4bd291cd023220bd84ff'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.499950 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857caa12f88f4bd291cd023220bd84ff'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.506807 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857caa12f88f4bd291cd023220bd84ff'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.507435 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857caa12f88f4bd291cd023220bd84ff'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.513936 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.notifications [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857caa12f88f4bd291cd023220bd84ff'} {{(pid=80124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.519647 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1456/2912] 10.222.0.45 () {58 vars in 1223 bytes} [Fri Apr 29 18:57:17 2022] DELETE /identity/v3/users/857caa12f88f4bd291cd023220bd84ff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 18:57:17.690528 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Authenticating user token {{(pid=80123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 18:57:17.692047 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.fernet_utils [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 18:57:17.704993 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59becf8f-cba4-4e85-a117-312b50a3dc37 admin admin] Validating token access rules against request {{(pid=80123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 18:57:17.759814 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98401350f90343bfb675fc3a572f111b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2ad2f44cc08416e8164cdae588a4916', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 18:57:17.760677 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 18:57:17.760954 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 18:57:17.761230 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] PATH_INFO: `/v3/projects/5c84406e8f6c4181a1f8b4372f8776ff` {{(pid=80123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 18:57:17.762382 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c84406e8f6c4181a1f8b4372f8776ff)` {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 18:57:17.764323 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] RBAC: Authorization granted {{(pid=80123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 18:57:17.808918 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c84406e8f6c4181a1f8b4372f8776ff', 'request_id': 'req-90165e81-4c6a-4dce-947e-c13839bd48ab'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.815234 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c84406e8f6c4181a1f8b4372f8776ff', 'request_id': 'req-90165e81-4c6a-4dce-947e-c13839bd48ab'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.820507 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c84406e8f6c4181a1f8b4372f8776ff', 'request_id': 'req-90165e81-4c6a-4dce-947e-c13839bd48ab'} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.830830 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] The token cache is being invalidate because project 5c84406e8f6c4181a1f8b4372f8776ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 18:57:17.831132 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.831764 dv-cinder-839987-1-smb devstack@keystone.service[80123]: DEBUG keystone.notifications [None req-90165e81-4c6a-4dce-947e-c13839bd48ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 18:57:17.833295 dv-cinder-839987-1-smb devstack@keystone.service[80123]: [pid: 80123|app: 0|req: 1457/2913] 10.222.0.45 () {58 vars in 1232 bytes} [Fri Apr 29 18:57:17 2022] DELETE /identity/v3/projects/5c84406e8f6c4181a1f8b4372f8776ff => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:00:49.843718 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Authenticating user token {{(pid=80124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:00:49.845135 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:00:49.918228 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba083c-21b6-4935-b27e-84bebb906a06 admin admin] Validating token access rules against request {{(pid=80124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:00:49.973818 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec1a79f8ea404a01b92ecabe8ca79b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79fac263d60b4f41b94ae64f0d4ff57f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:00:49.974457 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] REQUEST_METHOD: `GET` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:00:49.974741 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] SCRIPT_NAME: `/identity` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:00:49.975018 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:00:49.976867 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.fernet_utils [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:00:49.988005 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:00:49.989558 dv-cinder-839987-1-smb devstack@keystone.service[80124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd361-507e-46a1-a23f-73bd126c4ed1 service placement] RBAC: Authorization granted {{(pid=80124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:00:49.999726 dv-cinder-839987-1-smb devstack@keystone.service[80124]: [pid: 80124|app: 0|req: 1457/2914] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Apr 29 19:00:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)